-- Logs begin at Wed 2022-07-20 18:36:39 UTC, end at Wed 2022-07-20 19:48:06 UTC. -- Jul 20 19:18:49.178020 dv-cinder-850548-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:18:49.185551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:18:49 2022] *** Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: nodename: dv-cinder-850548-1-iscsi Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: machine: x86_64 Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: clock source: unix Jul 20 19:18:49.187551 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: pcre jit disabled Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: detected number of CPU cores: 4 Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: current working directory: / Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: your processes number limit is 47680 Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: your memory page size is 4096 bytes Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: detected max file descriptor number: 2048 Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: lock engine: pthread robust mutexes Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: thunder lock: enabled Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:18:49.188045 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:18:49.234759 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: Python main interpreter initialized at 0x56242f50a9c0 Jul 20 19:18:49.234759 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: python threads support enabled Jul 20 19:18:49.234759 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: your server socket listen backlog is limited to 100 connections Jul 20 19:18:49.234759 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:18:49.235165 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:18:49.235254 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: *** Operational MODE: preforking *** Jul 20 19:18:49.235489 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:18:49.235489 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: spawned uWSGI master process (pid: 103222) Jul 20 19:18:49.235701 dv-cinder-850548-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:18:49.236284 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: spawned uWSGI worker 1 (pid: 103223, cores: 1) Jul 20 19:18:49.240906 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: spawned uWSGI worker 2 (pid: 103224, cores: 1) Jul 20 19:18:49.240906 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:18:49.905202 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:18:49.906872 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:18:51.066329 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:18:51.066329 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: from cryptography.utils import int_from_bytes Jul 20 19:18:51.067034 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:18:51.067034 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 20 19:18:51.067410 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:18:51.067410 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: from cryptography.utils import int_from_bytes Jul 20 19:18:51.067560 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:18:51.067560 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: from cryptography.utils import int_from_bytes Jul 20 19:18:53.596190 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:18:53.596856 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:18:53.596989 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:18:53.597342 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:18:53.597597 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:18:53.597981 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.598305 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.598628 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.598949 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.599279 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.599591 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.599929 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.600085 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:18:53.600455 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.600548 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:18:53.600628 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.600794 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.600908 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:18:53.601137 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.601226 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:18:53.601463 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-1-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.601568 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:18:53.601787 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.601876 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602095 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602195 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602407 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602492 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602725 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.602818 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603033 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603202 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603353 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603446 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603658 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603800 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.603971 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.604155 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.604295 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605368 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605502 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605630 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605756 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605879 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-1-iscsi {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.605960 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606040 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606117 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606254 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606344 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606423 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606500 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606623 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606705 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606792 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.606941 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607034 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607266 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607352 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607578 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607788 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.607977 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-1-iscsi {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608096 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608297 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608391 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608610 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608701 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.608950 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609058 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609332 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609421 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609638 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609726 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.609955 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610045 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610261 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610348 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610669 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610886 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.610992 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611209 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611301 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-1-iscsi {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611528 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611615 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611846 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.611942 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612172 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612282 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612471 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612656 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612778 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.612992 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613113 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613303 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613431 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613622 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613735 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.613942 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614039 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614249 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614343 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614574 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614660 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614890 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.614986 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615206 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615293 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615524 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615620 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615777 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.615873 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616026 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616115 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616345 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616473 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616667 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.616756 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617016 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617105 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617321 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617410 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617570 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617660 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617875 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.617969 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618192 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618279 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618508 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618604 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618827 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.618917 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619077 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619174 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619327 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619436 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619640 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619736 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.619957 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620058 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620262 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620348 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620619 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620795 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.620974 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.621230 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.621387 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.621479 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.621695 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.621781 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622002 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622113 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622308 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622435 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622612 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622749 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.622929 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623072 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623244 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623394 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623563 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623704 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.623867 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624015 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624184 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624329 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624575 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624669 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624824 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.624994 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625155 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625303 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625491 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625589 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625809 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.625896 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626119 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626211 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626435 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626567 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626741 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.626825 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627043 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627140 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627348 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627449 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627649 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627740 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.627991 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628087 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628261 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628358 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628570 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628663 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628816 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.628922 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629141 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629309 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629440 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629528 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629753 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.629846 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630055 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630142 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630358 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630497 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630665 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.630961 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631055 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631263 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631358 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631562 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631647 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631862 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.631949 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632164 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632262 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632465 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632563 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632762 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.632850 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633089 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633187 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633394 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633487 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633695 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.633790 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634007 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634124 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634323 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634458 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634626 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634767 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.634926 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635075 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635226 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635395 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635528 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635697 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.635842 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.636503 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.636729 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.636859 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637176 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637267 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637493 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637579 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637803 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.637898 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638113 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638199 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638421 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638506 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638733 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.638828 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639042 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639130 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639351 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639438 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639652 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639746 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.639959 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640045 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640276 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640368 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640581 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640677 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.640914 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641004 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641220 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641313 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641524 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641611 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641830 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.641918 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.642136 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.642222 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.642438 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.642526 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.642742 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.642829 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.643041 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.643138 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.643359 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.643446 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.643678 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.643767 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.643984 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.644072 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.644287 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.644375 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.644591 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.644677 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.644926 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:18:53.645035 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.645261 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.645348 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.645591 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.645677 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.645909 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646003 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646229 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646323 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646556 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646642 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646873 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.646971 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647187 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647272 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647496 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647589 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647808 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.647895 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648125 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648225 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648431 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648524 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648741 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.648835 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649074 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649164 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649388 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649482 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649702 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.649790 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650027 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650115 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650342 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650437 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650657 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650745 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.650968 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.651054 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.651276 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.651363 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.651586 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.651776 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.652474 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.652561 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.652812 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.653177 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.653398 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.653495 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.653719 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.653815 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654035 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654131 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654358 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654458 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654675 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654761 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.654990 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655085 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655300 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655387 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655611 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655705 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.655922 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656018 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656241 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656329 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656553 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656640 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.656867 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657013 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657202 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657287 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657511 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657596 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657822 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.657916 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658129 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658224 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658435 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658522 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658743 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.658838 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659171 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659278 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659368 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659449 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659669 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659759 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.659978 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660065 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660292 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660387 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660599 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660688 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.660934 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661027 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661247 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661334 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661551 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661854 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.661942 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662157 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662262 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662464 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662552 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662764 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.662851 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663069 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663167 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663391 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663477 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663697 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.663791 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664003 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664097 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664356 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664463 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664637 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664773 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.664958 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665064 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665274 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665386 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665579 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665674 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665889 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.665977 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666196 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666302 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666502 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666602 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666820 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.666924 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667131 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667229 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667470 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667610 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667789 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.667876 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668094 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668243 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668382 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668527 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668677 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.668814 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669021 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669156 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669330 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669479 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669638 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669770 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.669949 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670089 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670264 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670408 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670572 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670716 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.670877 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671008 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671191 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671337 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671480 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671616 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671788 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.671933 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672096 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672265 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672410 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672547 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672682 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.672817 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673015 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673165 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673328 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673635 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673766 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.673943 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674081 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674242 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674380 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674551 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674686 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674854 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.674942 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675156 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675242 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675458 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675552 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675758 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.675846 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676057 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676145 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676376 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676473 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676684 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.676771 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677004 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677153 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677311 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677448 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677613 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677716 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.677950 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678050 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678252 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678359 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678577 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678673 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678898 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.678994 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679210 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679316 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679530 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679635 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679840 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.679935 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680151 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680250 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680455 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680541 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680765 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.680859 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681099 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681190 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681409 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681497 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681726 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.681822 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682035 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682123 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682350 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682436 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682661 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.682747 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683028 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683116 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683339 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683437 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683709 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.683803 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684026 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684114 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684354 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684440 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684667 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.684802 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685015 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685106 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685333 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685419 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685651 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685749 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.685961 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686084 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686276 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686401 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686583 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686705 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.686890 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687011 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687200 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687326 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687525 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687646 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687815 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.687930 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688120 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688233 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688436 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688551 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688743 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.688857 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689080 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689192 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689396 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689510 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689704 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.689816 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690005 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690126 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690316 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690430 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690643 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690772 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.690952 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691066 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691265 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691380 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691572 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691705 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691891 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.691978 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692201 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692297 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692507 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692593 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692812 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.692955 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693142 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693290 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693447 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693533 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693756 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.693856 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.694069 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.694156 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.694379 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.694501 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.696910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697040 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697040 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697186 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697255 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697386 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697466 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697535 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697606 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697673 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697738 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697813 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697880 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.697946 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698018 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698085 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698150 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698223 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698291 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698356 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.698421 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699008 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699134 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699219 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699774 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699847 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699925 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.699925 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700097 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700175 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700244 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700325 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700390 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700471 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700540 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700684 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.700853 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701020 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701268 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701387 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701490 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701636 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701805 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.701963 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702105 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702255 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702396 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702556 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702690 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.702869 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703001 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703182 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703315 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703488 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703621 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703800 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.703941 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.704127 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.704267 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.704460 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.704711 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.704851 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705076 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705167 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705383 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705469 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705701 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.705796 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706016 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706174 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706316 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706405 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706622 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706738 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.706922 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.707072 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.707227 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.707425 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.707542 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.707736 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708050 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708150 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708359 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708456 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708669 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.708755 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709025 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709132 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709341 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709444 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709654 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709754 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.709963 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710053 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710282 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710388 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710584 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710676 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710893 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.710997 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711202 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711287 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711506 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711611 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711810 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.711907 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712117 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712203 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712417 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712515 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712719 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.712815 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713044 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713135 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713356 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713443 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713659 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713760 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.713959 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.714047 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.714871 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.714972 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.715178 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.715299 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.715491 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.715696 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.715782 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716041 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716142 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716379 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716698 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.716782 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717029 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717140 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717334 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717422 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717636 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717724 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.717938 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718035 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718263 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718357 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718567 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718652 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718882 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.718969 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719197 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719283 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719506 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719664 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719810 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.719896 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720117 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720203 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720430 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720524 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720737 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.720824 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721068 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721156 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721368 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721461 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721742 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.721887 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722061 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722230 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722375 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722472 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722684 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722771 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.722992 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723087 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723309 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723405 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723619 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723706 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.723922 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724009 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724233 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724329 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724536 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724630 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724847 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.724963 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725176 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725278 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725480 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725566 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725781 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.725868 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726089 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726176 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726395 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726482 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726698 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.726784 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727008 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727095 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727309 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727395 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727615 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727700 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.727915 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728001 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728214 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728308 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728513 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728600 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728817 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.728947 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.729149 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.729243 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.729450 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.729546 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.730390 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.730492 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.730618 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.730707 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.730924 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731033 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731225 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731323 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731529 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731625 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731830 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.731934 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732130 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732220 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732439 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732532 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732758 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.732854 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733095 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733186 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733396 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733482 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733701 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.733799 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734000 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734094 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734302 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734391 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734603 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734699 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.734909 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735040 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735208 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735352 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735494 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735700 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.735797 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736008 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736095 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736368 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736465 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736679 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.736765 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737009 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737099 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737313 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737401 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737616 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737703 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.737915 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738003 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738241 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738335 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738592 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738917 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.738997 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739235 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739335 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739419 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739500 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739588 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739779 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.739878 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740085 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740176 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740394 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740560 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740703 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.740864 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741096 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741195 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741314 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741404 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741619 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741717 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.741927 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742036 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742228 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742319 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742528 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742626 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742844 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.742939 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743150 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743245 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743457 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743554 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743772 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.743869 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744090 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744186 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744405 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744506 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744705 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.744791 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.745041 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.745133 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.745373 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746032 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746270 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746399 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746581 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746671 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746896 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.746985 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747203 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747298 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747515 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747608 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747824 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.747912 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748128 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748213 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748433 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748518 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748739 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.748827 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749071 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749158 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749377 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749476 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749677 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749814 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.749997 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750130 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750305 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750446 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750612 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750755 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.750918 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751069 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751220 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751383 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751526 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751701 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.751827 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752019 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752251 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752347 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752557 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752734 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.752863 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753158 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753309 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753477 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753622 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753767 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.753903 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754076 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754221 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754386 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754516 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754684 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.754813 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755009 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755149 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755316 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755465 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755624 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755755 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.755930 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756074 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756253 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756414 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756548 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756678 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.756843 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757020 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757183 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757315 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757483 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757616 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757783 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.757921 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758081 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758287 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758419 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758603 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758749 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.758920 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759050 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759246 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759378 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759571 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759716 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.759899 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760030 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760203 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760343 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760518 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760684 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.760827 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.761007 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.761315 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.761538 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.761715 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.761891 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762016 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762226 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762430 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762574 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762830 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.762987 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.763133 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.763445 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.763579 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.763767 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.763897 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764086 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764293 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764434 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764573 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764709 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.764845 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765046 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765184 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765323 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765483 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765615 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.765801 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766011 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766154 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766357 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766535 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766665 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766796 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.766941 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767079 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767243 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767375 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767543 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767676 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767842 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.767987 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768224 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768368 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768500 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768631 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768788 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.768984 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769118 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769255 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769390 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769537 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769678 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769815 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.769960 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770094 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770226 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770434 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770580 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770749 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.770885 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771076 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771208 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771395 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771528 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771721 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.771854 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772027 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772178 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772372 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772518 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772663 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772796 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.772978 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773125 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773263 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773400 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773565 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773705 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.773868 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774020 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774158 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774301 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774676 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774826 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.774974 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775150 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775236 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775323 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775403 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775481 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775689 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.775792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776015 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776104 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776324 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776419 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776711 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.776861 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777068 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777159 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777386 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777549 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777704 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.777867 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.778294 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.778437 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.778581 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.778754 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.778883 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779066 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779192 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779378 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779494 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779686 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.779784 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780001 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780088 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780310 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780398 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780618 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780710 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.780950 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781074 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781278 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781381 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781585 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781691 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781888 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.781985 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782208 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782316 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782513 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782603 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782812 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.782898 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783114 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783199 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783411 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783499 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783750 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.783837 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784051 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784147 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784379 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784467 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784695 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.784783 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.785087 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.785212 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.785651 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.785910 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786210 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786505 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786600 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786695 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786842 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.786931 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.787176 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.787470 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.787849 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.787953 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788037 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788116 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788195 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788281 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788374 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788456 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788666 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788755 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.788997 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789091 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789315 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789405 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789627 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789715 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.789943 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.790216 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.790488 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.790634 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.790820 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.790909 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791144 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791235 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791463 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791551 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791777 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.791863 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.792092 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.792186 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.792956 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793051 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793277 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793365 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793593 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793704 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793908 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.793998 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794221 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794309 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794548 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794644 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794872 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.794961 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795198 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795286 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795532 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795620 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795848 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.795937 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796167 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796253 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796479 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796574 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796791 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.796943 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797170 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797271 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797482 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797570 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797785 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.797872 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798099 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798197 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798413 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798499 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798722 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.798806 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799031 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799120 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799340 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799507 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799651 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799739 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.799962 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800051 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800268 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800363 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800575 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800671 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.800921 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801029 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801213 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801303 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801538 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801637 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801860 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.801948 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802178 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802271 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802490 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802587 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802803 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.802890 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.803116 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.803320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.803629 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.803727 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.803946 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804034 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804277 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804365 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804600 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804699 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.804939 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805030 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805260 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805350 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805574 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805664 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805879 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.805972 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806185 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806271 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806488 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806577 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806796 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.806883 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807102 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807191 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807401 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807489 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807717 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.807803 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.808609 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.808821 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.809002 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.809188 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.809327 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.809509 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.809637 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810050 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810168 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810406 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810514 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810730 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.810868 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811060 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811150 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811391 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811481 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811712 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.811801 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812024 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812112 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812349 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812435 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812652 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812748 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.812976 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813119 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813293 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813382 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813599 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813699 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813900 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.813996 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814202 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814290 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814510 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814606 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814818 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.814906 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815121 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815217 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815432 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815595 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815747 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.815888 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816039 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816136 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816342 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816438 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816643 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816731 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.816970 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817115 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817282 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817382 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817584 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817680 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817887 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.817975 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818189 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818278 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818490 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818590 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818800 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.818895 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819100 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819196 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819496 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819710 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.819795 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820018 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820119 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820318 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820413 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820625 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820791 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.820999 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821121 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821321 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821467 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821626 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821769 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.821927 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822057 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822242 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822381 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822550 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822692 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.822870 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823003 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823181 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823315 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823518 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823672 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.823963 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.824095 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.824286 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.824515 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.824820 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.824967 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825180 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825269 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825505 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825592 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825838 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.825927 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826169 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826257 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826479 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826566 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826785 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.826881 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827090 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827216 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827416 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827512 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827725 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.827811 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828036 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828130 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828345 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828441 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828657 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828753 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.828989 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829081 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829301 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829400 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829610 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829704 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.829918 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.830005 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.830226 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.830313 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.830532 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.830626 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831021 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831172 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831432 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831533 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831616 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831695 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831774 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.831857 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832069 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832166 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832384 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832479 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832701 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.832790 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833040 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833145 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833358 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833462 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833665 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833763 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.833971 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834059 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834278 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834366 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834584 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834680 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834895 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.834983 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835225 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835346 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835531 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835631 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835832 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.835921 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836244 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836331 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836551 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836649 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836869 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.836984 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837207 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837344 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837515 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837616 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837834 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.837930 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838153 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838242 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838461 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838594 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838779 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.838875 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.839089 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.839695 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.839948 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840036 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840285 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840370 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840611 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840710 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.840952 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841056 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841257 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841362 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841562 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841658 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841863 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.841951 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842172 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842260 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842490 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842578 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842796 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.842882 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843097 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843192 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843396 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843485 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843703 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.843790 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844004 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844096 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844301 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844388 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844598 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844686 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844910 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.844999 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845220 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845310 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845518 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845606 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845817 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.845913 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846119 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846249 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846416 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846504 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846716 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.846822 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847013 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847112 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847317 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847444 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847615 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847717 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.847914 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848002 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848213 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848300 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848511 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848611 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848808 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.848918 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849175 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849265 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849504 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849593 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849813 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.849908 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850129 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850217 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850436 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850534 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850755 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.850842 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851059 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851145 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851379 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851466 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851692 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.851786 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852002 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852090 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852308 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852397 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852639 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852734 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.852972 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853075 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853280 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853369 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853589 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853685 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853894 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.853991 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.854200 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.854288 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.854508 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.854596 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.854915 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855027 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855242 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855331 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855546 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855633 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855868 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.855963 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856187 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856275 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856511 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856598 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856830 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.856934 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857168 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857267 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857500 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857588 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857815 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.857904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858128 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858224 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858436 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858531 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858745 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.858833 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859052 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859138 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859361 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859455 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859666 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859754 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.859975 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860061 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860285 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860380 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860598 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860686 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.860942 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861033 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861268 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861357 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861579 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861674 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861899 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.861989 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862226 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862378 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862567 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862715 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862866 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.862983 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863198 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863298 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863524 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863667 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863837 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.863926 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.864146 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.864242 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.864448 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.864536 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:18:53.864689 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:18:53.864787 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103224) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:18:53.927255 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO dbcounter [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Registered counter for database nova_api Jul 20 19:18:53.928173 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Registered counter for database nova_api Jul 20 19:18:54.041009 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.044435 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_db.sqlalchemy.engines [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.048447 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.050753 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writer thread running {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.106374 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.context [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5483e977-c2fb-4c18-b67f-daecf8b173f5(cell1) {{(pid=103224) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:18:54.107378 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.context [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5483e977-c2fb-4c18-b67f-daecf8b173f5(cell1) {{(pid=103223) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:18:54.109784 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:18:54.113516 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_concurrency.lockutils [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:18:54.113665 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:18:54.113665 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:18:54.113804 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_concurrency.lockutils [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:18:54.113804 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_concurrency.lockutils [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:18:54.114344 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:18:54.115945 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_concurrency.lockutils [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:18:54.116314 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Registered counter for database nova_cell0 Jul 20 19:18:54.117949 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO dbcounter [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Registered counter for database nova_cell0 Jul 20 19:18:54.120248 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Registered counter for database nova_cell1 Jul 20 19:18:54.122393 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO dbcounter [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Registered counter for database nova_cell1 Jul 20 19:18:54.129131 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.130327 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.132334 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_db.sqlalchemy.engines [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.135872 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_db.sqlalchemy.engines [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.135996 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.138540 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writer thread running {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.142224 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.283371 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writer thread running {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.287775 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO dbcounter [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Registered counter for database nova_cell0 Jul 20 19:18:54.293169 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO dbcounter [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Registered counter for database nova_cell0 Jul 20 19:18:54.297052 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_db.sqlalchemy.engines [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103224) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.301591 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writer thread running {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.302054 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG oslo_db.sqlalchemy.engines [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:18:54.306263 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writer thread running {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:18:54.643665 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:18:54.645798 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: WARNING keystonemiddleware.auth_token [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:18:54.650898 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:18:54.653662 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: WARNING keystonemiddleware.auth_token [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:18:54.998271 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: WARNING keystonemiddleware.auth_token [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:18:55.001171 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:18:55.004128 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: WARNING keystonemiddleware.auth_token [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:18:55.007043 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: WARNING keystonemiddleware.auth_token [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:18:55.009419 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56242f50a9c0 pid: 103223 (default app) Jul 20 19:18:55.011995 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:55.012865 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56242f50a9c0 pid: 103224 (default app) Jul 20 19:18:55.013350 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-c93072da-8baf-49c7-b337-ace4c3819569 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002359 Jul 20 19:18:55.013763 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Wed Jul 20 19:18:55 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:13.557747 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:13.560018 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003084 Jul 20 19:20:13.561248 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:13.582415 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_api:SELECT=3 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:13.583540 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_cell0:SELECT=3 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:13.584626 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_cell1:SELECT=3 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:13.585506 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:14.475231 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-b23e17e3-3a05-4488-9dc2-994e9aaa6752 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:14.505753 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-b23e17e3-3a05-4488-9dc2-994e9aaa6752 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928888 Jul 20 19:20:14.506497 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 19:20:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:16.929703 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:16.930653 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-cc7cd8af-031d-48bd-a633-8ac4ac9adc68 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jul 20 19:20:16.931164 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 2/4] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:17.386955 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-5ff6a4e7-87a7-4b34-a896-8e41245b75bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "swap": 0}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:17.406228 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:17.406228 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: warnings.warn(msg) Jul 20 19:20:17.434498 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-5ff6a4e7-87a7-4b34-a896-8e41245b75bc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496563 Jul 20 19:20:17.435054 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 3/5] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:17.449328 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:17.450476 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:17.451222 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell1:SELECT=3 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:17.451939 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:17.658725 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f1e07687-ca6b-476f-9013-bb66a8b8e529 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:17.661188 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:17.661188 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:20:17.733732 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f1e07687-ca6b-476f-9013-bb66a8b8e529 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290278 Jul 20 19:20:17.734730 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 3/6] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 19:20:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:20.039179 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-5ff6a4e7-87a7-4b34-a896-8e41245b75bc admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:20.040205 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-5ff6a4e7-87a7-4b34-a896-8e41245b75bc admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 20 19:20:20.040620 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 4/7] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:20.722815 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4e6cd5c7-451e-4794-b095-5d04354aa261 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "vcpus": 1, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:20.741287 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:20.741287 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:20:20.765191 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4e6cd5c7-451e-4794-b095-5d04354aa261 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717397 Jul 20 19:20:20.772670 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 4/8] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:20.780805 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-6282917e-6227-4ae6-b314-a4c70ac74eab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:20.782441 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:20.782441 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: warnings.warn(msg) Jul 20 19:20:20.816747 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-6282917e-6227-4ae6-b314-a4c70ac74eab admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042655 Jul 20 19:20:20.817536 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 5/9] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 19:20:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:23.130491 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-4e6cd5c7-451e-4794-b095-5d04354aa261 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:23.131533 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-4e6cd5c7-451e-4794-b095-5d04354aa261 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 20 19:20:23.131976 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:23.546004 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-4b6bbf24-749b-447a-8dbe-70bf23dc0558 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:23.564360 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-4b6bbf24-749b-447a-8dbe-70bf23dc0558 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426346 Jul 20 19:20:23.564923 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 6/11] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:23.577032 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-6a6f589b-d075-4dad-b41e-5d4c8145f161 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:23.599630 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-6a6f589b-d075-4dad-b41e-5d4c8145f161 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026417 Jul 20 19:20:23.600188 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 6/12] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 19:20:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:20:25.954889 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-4b6bbf24-749b-447a-8dbe-70bf23dc0558 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:25.955957 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-4b6bbf24-749b-447a-8dbe-70bf23dc0558 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 20 19:20:25.956448 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 7/13] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:26.415462 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-45258294-9ffe-4be3-8886-ae03ca2552d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "disk": 10}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:26.434517 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-45258294-9ffe-4be3-8886-ae03ca2552d1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467358 Jul 20 19:20:26.435134 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 7/14] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:26.447480 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-020ee6da-5c30-408d-b0de-b4865e4e346a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:26.470765 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-020ee6da-5c30-408d-b0de-b4865e4e346a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027453 Jul 20 19:20:26.471601 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 8/15] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 19:20:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:28.770727 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-45258294-9ffe-4be3-8886-ae03ca2552d1 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:28.771725 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-45258294-9ffe-4be3-8886-ae03ca2552d1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 20 19:20:28.772123 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 8/16] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:29.234845 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "d4", "vcpus": 4}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:29.254273 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476036 Jul 20 19:20:29.255207 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 9/17] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:20:29.267889 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7d86c60f-6278-4a06-b584-1013daebe360 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:29.296549 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7d86c60f-6278-4a06-b584-1013daebe360 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032731 Jul 20 19:20:29.298213 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 9/18] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 19:20:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:20:31.615947 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:31.617025 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 20 19:20:31.617436 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 10/19] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:32.074592 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-6b93040c-0a2c-4fee-afcd-470559ba5c6d admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:32.104159 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-6b93040c-0a2c-4fee-afcd-470559ba5c6d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479475 Jul 20 19:20:32.105984 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 19:20:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:20:34.446826 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:34.447945 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-fd9528ca-731b-4bc0-8b3d-0a29a49514ab admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 Jul 20 19:20:34.448675 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 11/21] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:34.982518 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e85f6906-a676-4cfd-acb6-40e6c2b2d275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:35.003192 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e85f6906-a676-4cfd-acb6-40e6c2b2d275 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.548076 Jul 20 19:20:35.003855 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 11/22] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:20:35.016371 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-4fbd160b-f2ca-4aae-94e2-a696cb2564e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:35.042343 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-4fbd160b-f2ca-4aae-94e2-a696cb2564e2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029755 Jul 20 19:20:35.042955 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 12/23] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 19:20:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:37.538274 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e85f6906-a676-4cfd-acb6-40e6c2b2d275 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:37.539332 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e85f6906-a676-4cfd-acb6-40e6c2b2d275 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 20 19:20:37.539728 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:37.954509 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-271479b2-5ca1-4937-b7a2-b01ef0e9be09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "disk": 20, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:37.972934 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-271479b2-5ca1-4937-b7a2-b01ef0e9be09 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426552 Jul 20 19:20:37.973529 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 13/25] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:37.986095 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-6338d218-a34c-4d84-a4e9-f06655fc7ac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:38.010317 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-6338d218-a34c-4d84-a4e9-f06655fc7ac3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027780 Jul 20 19:20:38.010809 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 13/26] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 19:20:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:20:40.283762 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-271479b2-5ca1-4937-b7a2-b01ef0e9be09 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:40.284778 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-271479b2-5ca1-4937-b7a2-b01ef0e9be09 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 19:20:40.285221 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 14/27] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:40.730504 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e2a4689f-61d5-4477-b81d-60d671e97f9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "ram": 4096}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:40.755037 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e2a4689f-61d5-4477-b81d-60d671e97f9a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.463078 Jul 20 19:20:40.756451 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 14/28] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:40.775830 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-8fe0f344-2810-4167-a287-0378d66b4377 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:40.804349 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-8fe0f344-2810-4167-a287-0378d66b4377 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039854 Jul 20 19:20:40.805318 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 15/29] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 19:20:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:20:43.160064 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e2a4689f-61d5-4477-b81d-60d671e97f9a admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:43.161133 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e2a4689f-61d5-4477-b81d-60d671e97f9a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 20 19:20:43.161534 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 15/30] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:43.643638 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-5847d07a-c823-4ada-8088-81667844dd50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:43.649350 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:43.669708 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-5847d07a-c823-4ada-8088-81667844dd50 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501412 Jul 20 19:20:43.670943 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 16/31] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:43.684053 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-63084203-dc08-46ad-9ce5-8e91a49a4b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:43.713271 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-63084203-dc08-46ad-9ce5-8e91a49a4b8b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033525 Jul 20 19:20:43.720930 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 16/32] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 19:20:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:20:46.138777 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-5847d07a-c823-4ada-8088-81667844dd50 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:20:46.139818 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-5847d07a-c823-4ada-8088-81667844dd50 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 19:20:46.140213 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 17/33] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:20:46.661276 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5"}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:46.751247 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.601229 Jul 20 19:20:46.765837 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 17/34] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 19:20:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:20:46.780188 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-f196fd62-2147-4955-a3e1-993f3141820c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:20:46.806006 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-f196fd62-2147-4955-a3e1-993f3141820c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034860 Jul 20 19:20:46.806918 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 18/35] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 19:20:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:21:06.574469 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:06.575487 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 20 19:21:06.575891 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 18/36] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:21:06.587177 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:07.002776 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-c20646bd-8738-471c-ae0b-65bdbf216568 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:07.020810 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-c20646bd-8738-471c-ae0b-65bdbf216568 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.438540 Jul 20 19:21:07.021422 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 19/37] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 19:21:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:08.125758 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:08.127055 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-9875f532-d452-4f22-830d-e17f2bee840f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Jul 20 19:21:08.127671 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 19/38] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:08.657327 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-04ef31bf-67cb-496d-a4c4-6801638b9e25 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:08.663068 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.wsgi [None req-04ef31bf-67cb-496d-a4c4-6801638b9e25 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-04ef31bf-67cb-496d-a4c4-6801638b9e25 admin admin] Request method failure captured: Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept: application/json Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept-Encoding: gzip, deflate Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Connection: keep-alive Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Content-Length: 0 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Host: 10.222.0.79 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-System-Scope: None Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: User-Agent: python-novaclient Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Auth-Token: gAAAAABi2FWkV3HthgBkDe5Er8YbpDzDMbM-5krB_C8w2GSOzScRmHcZEaq4WnoRGquO_PHnTH8OoAP2pzNnsgq1kTbERvCxaUnuHhiBPLPF9imGiJTZlVbUH8spNesQydl05PngYx6_EKc6hBC2Ghah9lKNQ6Yh5dQXabXB0Y-7AEicEmgObXM Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Id: None Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Name: None Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Identity-Status: Confirmed Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Is-Admin-Project: True Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Id: default Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Name: Default Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Name: admin Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Role: reader,admin,member Jul 20 19:21:08.667364 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Roles: reader,admin,member Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant: admin Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Name: admin Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User: admin Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Id: default Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Name: Default Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Name: admin Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: method: > Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: exception: Flavor 42 could not be found. Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: action_args: {'id': '42'} Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:08.668979 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:08.669860 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.670987 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-04ef31bf-67cb-496d-a4c4-6801638b9e25 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:08.672265 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-04ef31bf-67cb-496d-a4c4-6801638b9e25 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402086 Jul 20 19:21:08.672265 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 20/39] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 19:21:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:21:08.678927 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-84b3f786-64cd-4602-86bc-ebac60a425e9 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:08.682618 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:08.702569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-84b3f786-64cd-4602-86bc-ebac60a425e9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027555 Jul 20 19:21:08.703162 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 20/40] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:08.713171 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-8b6b398b-93e6-469c-81fe-dd203fa01368 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:08.734680 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-8b6b398b-93e6-469c-81fe-dd203fa01368 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025299 Jul 20 19:21:08.735214 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 21/41] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:08.745818 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-33122348-fc65-45d6-97f1-f18e882a0640 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:08.751587 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-33122348-fc65-45d6-97f1-f18e882a0640 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-33122348-fc65-45d6-97f1-f18e882a0640 admin admin] Request method failure captured: Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.79 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2FWkV3HthgBkDe5Er8YbpDzDMbM-5krB_C8w2GSOzScRmHcZEaq4WnoRGquO_PHnTH8OoAP2pzNnsgq1kTbERvCxaUnuHhiBPLPF9imGiJTZlVbUH8spNesQydl05PngYx6_EKc6hBC2Ghah9lKNQ6Yh5dQXabXB0Y-7AEicEmgObXM Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Role: reader,admin,member Jul 20 19:21:08.754910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Roles: reader,admin,member Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: method: > Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: exception: Flavor 42 could not be found. Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '42'} Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:08.756411 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:08.757320 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:08.758408 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-33122348-fc65-45d6-97f1-f18e882a0640 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:08.759428 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-33122348-fc65-45d6-97f1-f18e882a0640 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015413 Jul 20 19:21:08.759428 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 21/42] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 19:21:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:21:09.739542 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-8b6b398b-93e6-469c-81fe-dd203fa01368 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:09.740692 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-8b6b398b-93e6-469c-81fe-dd203fa01368 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 20 19:21:09.741129 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 22/43] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:10.287309 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-5483a881-29bd-4f3c-b701-899269482870 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:10.293109 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-5483a881-29bd-4f3c-b701-899269482870 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-5483a881-29bd-4f3c-b701-899269482870 admin admin] Request method failure captured: Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.79 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2FWlDqcHyI0qbtUBDlXKsc08xXDGEEoT-mNli7FkBBnSSUP3FBgQKHtZechFyQhGH1SmEUiIGnVZQvPk44if5JzcZU1Xh02B_1AFMtCAdX0RZ2_0DIRpA5cCUCnYotVZMRZNwA-zrECwu-oGo7uLpnGNviBOn2PUUAEWopWdNiwLqGE Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Role: reader,admin,member Jul 20 19:21:10.294640 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Roles: reader,admin,member Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: method: > Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: exception: Flavor 84 could not be found. Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '84'} Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:10.296194 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:10.301496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.302792 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-5483a881-29bd-4f3c-b701-899269482870 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:10.304007 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-5483a881-29bd-4f3c-b701-899269482870 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.416159 Jul 20 19:21:10.304007 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 22/44] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 19:21:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 19:21:10.306251 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-75841da3-189c-4006-9e8b-2fd05fd36346 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:10.320251 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-75841da3-189c-4006-9e8b-2fd05fd36346 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017988 Jul 20 19:21:10.320807 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:10.331416 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7cea22cd-2d89-4f5c-b767-fc819faad872 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:10.345445 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7cea22cd-2d89-4f5c-b767-fc819faad872 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017427 Jul 20 19:21:10.345987 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 23/46] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:10.355654 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-c5f99e52-f4a4-43b5-b338-b7082f51af1b admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:10.361188 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.wsgi [None req-c5f99e52-f4a4-43b5-b338-b7082f51af1b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-c5f99e52-f4a4-43b5-b338-b7082f51af1b admin admin] Request method failure captured: Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept: application/json Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept-Encoding: gzip, deflate Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Connection: keep-alive Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Content-Length: 0 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Host: 10.222.0.79 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-System-Scope: None Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: User-Agent: python-novaclient Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Auth-Token: gAAAAABi2FWlDqcHyI0qbtUBDlXKsc08xXDGEEoT-mNli7FkBBnSSUP3FBgQKHtZechFyQhGH1SmEUiIGnVZQvPk44if5JzcZU1Xh02B_1AFMtCAdX0RZ2_0DIRpA5cCUCnYotVZMRZNwA-zrECwu-oGo7uLpnGNviBOn2PUUAEWopWdNiwLqGE Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Id: None Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Name: None Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Identity-Status: Confirmed Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Is-Admin-Project: True Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Id: default Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Name: Default Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Name: admin Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Role: reader,admin,member Jul 20 19:21:10.362706 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Roles: reader,admin,member Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant: admin Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Name: admin Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User: admin Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Id: default Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Name: Default Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Name: admin Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: method: > Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: exception: Flavor 84 could not be found. Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: action_args: {'id': '84'} Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:10.364467 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:10.366331 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:10.367617 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-c5f99e52-f4a4-43b5-b338-b7082f51af1b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:10.369612 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-c5f99e52-f4a4-43b5-b338-b7082f51af1b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012194 Jul 20 19:21:10.369612 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 24/47] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 19:21:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:21:11.347335 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7cea22cd-2d89-4f5c-b767-fc819faad872 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:11.348378 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7cea22cd-2d89-4f5c-b767-fc819faad872 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 20 19:21:11.348767 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 24/48] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:11.890443 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-29f43939-4bb8-4757-bfdf-071fc6ce009c admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:11.896642 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.wsgi [None req-29f43939-4bb8-4757-bfdf-071fc6ce009c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-29f43939-4bb8-4757-bfdf-071fc6ce009c admin admin] Request method failure captured: Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept: application/json Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Accept-Encoding: gzip, deflate Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Connection: keep-alive Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Content-Length: 0 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Host: 10.222.0.79 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Openstack-System-Scope: None Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: User-Agent: python-novaclient Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Auth-Token: gAAAAABi2FWnu6i0-egqlVkQQJczGHsURclN9afYQlMvspRVBfkdVhrpOSPyf32ruq_rr_RTTELUuxfcnb01MNhIGlRFNelo_V3IlG8lt7Hfs5wUxPR8N7B13MtYIgauCdOUs1MvbD6cTgwmzvLxSUQ3XUKDpAHTt21o0ZvMs5U8W20SXFCsoAA Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Id: None Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Domain-Name: None Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Identity-Status: Confirmed Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Is-Admin-Project: True Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Id: default Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Domain-Name: Default Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Project-Name: admin Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Role: reader,admin,member Jul 20 19:21:11.898212 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Roles: reader,admin,member Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant: admin Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-Tenant-Name: admin Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User: admin Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Id: default Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Domain-Name: Default Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: X-User-Name: admin Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: method: > Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: exception: Flavor 451 could not be found. Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: action_args: {'id': '451'} Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:11.900576 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:11.901646 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.902904 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-29f43939-4bb8-4757-bfdf-071fc6ce009c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:11.904168 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-29f43939-4bb8-4757-bfdf-071fc6ce009c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.412875 Jul 20 19:21:11.904168 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 25/49] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:21:11.911002 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-15d88d47-0376-48c4-b97a-9ca8875285c1 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:11.925624 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-15d88d47-0376-48c4-b97a-9ca8875285c1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018152 Jul 20 19:21:11.926180 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 25/50] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:21:11.936284 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:11.951614 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018846 Jul 20 19:21:11.952165 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 26/51] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 19:21:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:11.962300 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e77e3f51-4933-43e8-acbe-0814e11b8601 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:11.967718 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.wsgi [None req-e77e3f51-4933-43e8-acbe-0814e11b8601 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e77e3f51-4933-43e8-acbe-0814e11b8601 admin admin] Request method failure captured: Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept: application/json Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Accept-Encoding: gzip, deflate Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Connection: keep-alive Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Content-Length: 0 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Host: 10.222.0.79 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-Api-Version: compute 2.90 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Openstack-System-Scope: None Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: User-Agent: python-novaclient Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Auth-Token: gAAAAABi2FWnu6i0-egqlVkQQJczGHsURclN9afYQlMvspRVBfkdVhrpOSPyf32ruq_rr_RTTELUuxfcnb01MNhIGlRFNelo_V3IlG8lt7Hfs5wUxPR8N7B13MtYIgauCdOUs1MvbD6cTgwmzvLxSUQ3XUKDpAHTt21o0ZvMs5U8W20SXFCsoAA Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Id: None Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Domain-Name: None Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Identity-Status: Confirmed Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Is-Admin-Project: True Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Id: default Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Domain-Name: Default Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Project-Name: admin Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Role: reader,admin,member Jul 20 19:21:11.969244 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Roles: reader,admin,member Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8afe543881644c988270ab8de48728b1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8afe543881644c988270ab8de48728b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8afe543881644c988270ab8de48728b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant: admin Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Id: 8afe543881644c988270ab8de48728b1 Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-Tenant-Name: admin Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User: admin Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Id: default Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Domain-Name: Default Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Id: 0b2e9296115548cda14048313e8cf43e Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: X-User-Name: admin Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: method: > Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: exception: Flavor 451 could not be found. Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: action_args: {'id': '451'} Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:21:11.970752 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:11.971569 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: ERROR nova.api.openstack.wsgi Jul 20 19:21:11.972582 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e77e3f51-4933-43e8-acbe-0814e11b8601 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103224) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:21:11.973599 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e77e3f51-4933-43e8-acbe-0814e11b8601 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012520 Jul 20 19:21:11.973599 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 26/52] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:21:12.966089 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:12.967133 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 20 19:21:12.967532 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 27/53] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:13.511565 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7e4d8cfd-8c9e-43c7-b7fc-f0f3cb7481a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:21:13.529496 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7e4d8cfd-8c9e-43c7-b7fc-f0f3cb7481a3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.423550 Jul 20 19:21:13.530305 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 27/54] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 19:21:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:14.528764 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:14.530109 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 20 19:21:14.530505 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 28/55] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:15.079620 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-f6d77628-0616-4609-8a41-2706ccee1dde admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:21:15.097745 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-f6d77628-0616-4609-8a41-2706ccee1dde admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.428565 Jul 20 19:21:15.098330 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 28/56] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 19:21:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:16.112950 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:16.113994 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 20 19:21:16.114398 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 29/57] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:16.658834 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-6216805c-e7fa-4d55-8092-1fb664e150da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:21:16.677655 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-6216805c-e7fa-4d55-8092-1fb664e150da admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.419684 Jul 20 19:21:16.678215 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 29/58] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 19:21:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:17.689519 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:17.690838 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Jul 20 19:21:17.691354 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 30/59] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:18.246188 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-0312f6f1-10c3-493f-adab-395b8c6c618b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:21:18.266090 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-0312f6f1-10c3-493f-adab-395b8c6c618b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.432471 Jul 20 19:21:18.266765 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 30/60] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 19:21:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:19.268341 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:19.269385 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 20 19:21:19.269783 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 31/61] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:19.814783 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-7e543a3a-0580-4fcf-83a9-f885a1c243f9 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:19.834910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-7e543a3a-0580-4fcf-83a9-f885a1c243f9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.425894 Jul 20 19:21:19.835457 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 31/62] 10.222.0.79 () {60 vars in 1202 bytes} [Wed Jul 20 19:21:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:22:12.842638 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:12.843677 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-e3e7f2d2-c6b4-4480-ac66-ac1fd0188fb9 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 20 19:22:12.844073 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 32/63] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 19:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:22:12.854588 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:13.245694 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-3a2afb02-bb57-4256-9eaf-e8a9eda827be admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:13.265293 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-3a2afb02-bb57-4256-9eaf-e8a9eda827be admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415227 Jul 20 19:22:13.265837 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 32/64] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 19:22:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:22:13.287214 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG dbcounter [-] [103223] Writing DB stats nova_api:SELECT=14 {{(pid=103223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:13.292191 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-1c8f5b4d-a144-417d-a54e-31bc01ff74f3 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:13.300281 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-1c8f5b4d-a144-417d-a54e-31bc01ff74f3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014736 Jul 20 19:22:13.300811 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 33/65] 10.222.0.79 () {60 vars in 1282 bytes} [Wed Jul 20 19:22:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:22:13.312740 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-54898f5b-0327-4e71-99e7-0cbb7aa70957 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:13.320493 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-54898f5b-0327-4e71-99e7-0cbb7aa70957 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011360 Jul 20 19:22:13.321661 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 33/66] 10.222.0.79 () {60 vars in 1285 bytes} [Wed Jul 20 19:22:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:22:13.333320 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:13.342110 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012241 Jul 20 19:22:13.342580 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 34/67] 10.222.0.79 () {60 vars in 1285 bytes} [Wed Jul 20 19:22:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:22:13.354137 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-e357c58b-7dba-41de-aa9c-bfa0061e2523 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:22:13.361873 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-e357c58b-7dba-41de-aa9c-bfa0061e2523 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011461 Jul 20 19:22:13.362395 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 34/68] 10.222.0.79 () {60 vars in 1282 bytes} [Wed Jul 20 19:22:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.161006 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.162186 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Jul 20 19:25:41.162583 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 35/69] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:41.311955 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=6 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.473754 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.474910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:25:41.474910 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:25:41.476104 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.476590 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.477396 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.477819 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.511515 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-d77faef5-120f-4d37-9797-c36f410eb3c9 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200921 Jul 20 19:25:41.512062 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 35/70] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:25:42.343764 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.344766 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 19:25:42.345225 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 36/71] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:42.536831 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.538072 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:25:42.538072 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:25:42.539254 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.539694 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.540483 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.541082 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.561189 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-d95cd54c-c769-4334-b418-479e063366b4 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077136 Jul 20 19:25:42.561776 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 36/72] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:25:53.871370 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:53.872385 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 19:25:53.872798 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:54.026323 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell0:SELECT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.026932 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_cell1:SELECT=4 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.027481 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG dbcounter [-] [103224] Writing DB stats nova_api:SELECT=8 {{(pid=103224) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:54.089117 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.090352 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:25:54.090352 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:25:54.091727 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.092328 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.093006 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.093591 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.122275 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-25fae656-d746-4310-93c8-b29653b0c9cb admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.101144 Jul 20 19:25:54.123087 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 37/74] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:25:54.975387 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: DEBUG nova.api.openstack.wsgi [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] Calling method '>' {{(pid=103223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.976430 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: INFO nova.api.openstack.requestlog [None req-74d78a1b-02d2-453c-93fd-f57cc5570e94 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 20 19:25:54.976833 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: [pid: 103223|app: 0|req: 38/75] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:55.180253 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG nova.api.openstack.wsgi [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] Calling method '>' {{(pid=103224) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:55.182145 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:25:55.182145 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: warnings.warn(msg) Jul 20 19:25:55.183389 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.183854 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.184765 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.185213 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: DEBUG oslo_concurrency.lockutils [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103224) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.206738 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: INFO nova.api.openstack.requestlog [None req-c71c818f-7dfb-40b2-bdb4-591ea3d4c014 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085848 Jul 20 19:25:55.207317 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: [pid: 103224|app: 0|req: 38/76] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 19:25:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:51.527036 dv-cinder-850548-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 19:26:51.528063 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: Wed Jul 20 19:26:51 2022 - graceful shutdown triggered... Jul 20 19:26:51.528616 dv-cinder-850548-1-iscsi devstack@n-api.service[103224]: Gracefully killing worker 2 (pid: 103224)... Jul 20 19:26:51.531118 dv-cinder-850548-1-iscsi devstack@n-api.service[103223]: Gracefully killing worker 1 (pid: 103223)... Jul 20 19:26:52.529076 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: worker 1 buried after 1 seconds Jul 20 19:26:52.529654 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: worker 2 buried after 1 seconds Jul 20 19:26:52.529654 dv-cinder-850548-1-iscsi devstack@n-api.service[103222]: goodbye to uWSGI. Jul 20 19:26:52.530677 dv-cinder-850548-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 19:26:52.531240 dv-cinder-850548-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 19:26:52.534306 dv-cinder-850548-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:26:52.544133 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:26:52.546807 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:26:52 2022] *** Jul 20 19:26:52.546966 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: nodename: dv-cinder-850548-1-iscsi Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: machine: x86_64 Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: clock source: unix Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: pcre jit disabled Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: detected number of CPU cores: 4 Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: current working directory: / Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: your processes number limit is 47680 Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: your memory page size is 4096 bytes Jul 20 19:26:52.547105 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: detected max file descriptor number: 2048 Jul 20 19:26:52.547821 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: lock engine: pthread robust mutexes Jul 20 19:26:52.549846 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: thunder lock: enabled Jul 20 19:26:52.550039 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:26:52.550147 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:26:52.594711 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: Python main interpreter initialized at 0x56343a5b29c0 Jul 20 19:26:52.594711 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: python threads support enabled Jul 20 19:26:52.594711 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: your server socket listen backlog is limited to 100 connections Jul 20 19:26:52.594711 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:26:52.595150 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:26:52.595150 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: *** Operational MODE: preforking *** Jul 20 19:26:52.595425 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:26:52.595425 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: spawned uWSGI master process (pid: 117929) Jul 20 19:26:52.595635 dv-cinder-850548-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:26:52.596507 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: spawned uWSGI worker 1 (pid: 117948, cores: 1) Jul 20 19:26:52.596635 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: spawned uWSGI worker 2 (pid: 117949, cores: 1) Jul 20 19:26:52.596943 dv-cinder-850548-1-iscsi devstack@n-api.service[117929]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:26:53.264491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:26:53.269828 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:26:54.480281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:26:54.480281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: from cryptography.utils import int_from_bytes Jul 20 19:26:54.482903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:26:54.482903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: from cryptography.utils import int_from_bytes Jul 20 19:26:54.515372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:26:54.515372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: from cryptography.utils import int_from_bytes Jul 20 19:26:54.515372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:26:54.515372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: from cryptography.utils import int_from_bytes Jul 20 19:26:56.815829 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:26:56.816385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:26:56.816625 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:26:56.817032 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:26:56.817300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:26:56.817708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.818032 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.818368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.818698 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.819041 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.819379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.819684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.820013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.820351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.820623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.820976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.821357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-1-iscsi {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.821696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.822016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.822338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.822666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.822980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.823314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.823630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.824142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.824920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.825615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.825615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.825906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.826232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.826552 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.826886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.827205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.827541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.827861 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.828276 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-1-iscsi {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.828600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.828950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.829269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.829709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.830020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.830340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.830674 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.831018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.831336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.831686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.832006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.832336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.832664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.833005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.833319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.833641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.833975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.834294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.834608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.834870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.835189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.835520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.835849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.836185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.836444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.836703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.837571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.837906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.838224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.838549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.838868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.839185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.839502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.839818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.840134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.840448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.840777 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.841131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.841462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.841777 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.842108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.842515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.842773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.843090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.843448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.843770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.844091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.844423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.844752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.845093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.845413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.845728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.846057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.846407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.846724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.846985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.847302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.847626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.847960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.848275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.848598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.849002 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.849320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.849638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.849957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.850277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.850594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.850911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.851227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.851546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.851864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.852259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.853209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.853621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.854070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.854392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.854726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.855034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.855362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.855684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.856004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.857930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.858233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.858553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.858875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.859208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.859527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.859847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.860163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.860478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.860797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.860997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:26:56.861434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.861590 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:26:56.861738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.861738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.862012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:26:56.862167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.862315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:26:56.862458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.862608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:26:56.862759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.862899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863798 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.863962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.864115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.864263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.864449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.864602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.864776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.864972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.865556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.865728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.865880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.865880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.866167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.866343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.866487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.866638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850548-1-iscsi {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.867017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.867177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.867320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.867466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.867607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.867748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.867905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.868062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.868233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.869178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.869411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.869571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869653 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.869747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.869908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.869986 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.870057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.870134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.870447 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.870563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.870640 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.870719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.870910 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.871114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.871385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.871543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.871711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.871922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.872103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.872275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.872444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.872681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.872854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850548-1-iscsi {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.873045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.873186 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.873331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.873462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.873640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.873782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.874029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.874165 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.874356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.874497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.874672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.874809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.874993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.875134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.875331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.875457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.875646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.875752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.875978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.876167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.876309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.876408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.876632 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.876729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.876974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.877270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.877384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.877586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.877679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.877905 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.878004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.878226 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.878326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.878554 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.878647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.878869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.878975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.879183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.879275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.879440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.879539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.879755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.879862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.880086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.880187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.880415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.880507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.880735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.880834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.881016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.881111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.881275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.881368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.881601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.881696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.881930 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.882085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.882248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.882395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.882563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.882725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.882885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.883055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.883211 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.883363 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.883521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.883663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.883803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.884031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.884188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.884407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.884562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.884715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.884863 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.885052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.885193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.885346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.885523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.885708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.885876 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.886020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.886169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.886320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.886830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.886993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.887153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.887298 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.887451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.887676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.887832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.887973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.888114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.888261 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.888416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.888558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.888704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.888852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.889121 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.889274 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.889434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.889576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.889722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.889862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.890001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.890140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.890297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.890438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.890585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.890726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.890865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.890865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.891153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.891332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.891475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.891614 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.891762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.891909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.892058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.892212 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.892366 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.892513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.892653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.892800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.892970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.893127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.893288 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.893435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.893584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.893731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.893887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.894034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.894175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.894455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.894637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.894800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.894957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.895107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.895107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.895399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.895547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.895547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.895828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.895977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.896126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.896268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.896408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.896576 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.897146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.897300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.897449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.897589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.897835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.897999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.898141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.898287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.898437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.898587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.898727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.898867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.899007 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.899163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.899860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.900028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.900237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.900388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.900529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.900668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.900818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.900996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.901147 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.901288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.901288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.901567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.901716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.901857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.902004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.902162 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.902310 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.902460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.902610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.902750 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.902897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.903037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.903185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.903410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.903561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.903702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.903849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.903989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.904140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.904295 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.904437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.904576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.904726 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.904907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.905074 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.905226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.905368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.905508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.905654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.905794 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.905935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.906093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.906352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.906507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.906648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.906996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.907414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:26:56.907569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.907711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.907869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.908348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.908504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.908660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.908819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.908985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.909869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910287 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.910903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911196 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.911921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.912833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913528 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.913970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.914118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.914259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.914406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.915857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.916763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.917126 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.917518 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.917677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.917825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.917968 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.918270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.918511 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.918665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.918814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.918956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.919991 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920720 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.920868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.921920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922217 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922534 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922833 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.922973 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923550 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.923993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924295 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.924905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925358 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925653 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.925951 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.926959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.927105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.927260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.927576 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.927805 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.927963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.928192 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.928387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.928622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.928778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.928949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929123 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.929877 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930180 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.930750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931559 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.931891 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932049 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.932967 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.933922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934512 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.934793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.935949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936089 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936393 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.936828 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.937008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.937150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.937297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.937444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.937776 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938643 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.938879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939032 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939181 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939330 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.939911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940355 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.940809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941021 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941322 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.941898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942179 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.942937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.943999 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.944899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.945946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946522 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.946992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.947140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.947295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.947450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.947597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.947917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.948098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.948344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.948344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.948655 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.948811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.949965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950266 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950421 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.950897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.951966 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.952897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953377 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.953987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954767 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.954919 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.955991 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.956956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.957132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.957292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958121 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.958948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959115 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.959883 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960628 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.960956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.961146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.961391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.961557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.961706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.962400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.962550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.962708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.962872 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963595 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.963904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.964828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965180 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.965932 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.966088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.966254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.966515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.966790 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.966987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.967173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.967367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.967559 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.967753 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.968139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.968330 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.968514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.968706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.968706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.969093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.969288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.969483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.969676 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.969860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970042 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970236 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970804 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.970996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.971224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.971437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.971606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.971765 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.971954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972418 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972722 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.972888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.973976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.974277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.974433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.974588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.974736 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.974882 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975432 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.975737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.976997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.977167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.977324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.978353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.978534 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.978756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979000 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979218 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979837 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.979993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980295 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.980960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981582 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.981887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.982817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.983880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.984994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.985920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986687 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.986990 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.987910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.988056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.988211 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.988544 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.988710 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.988860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.989965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.990945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.991862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.992796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993324 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.993972 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994823 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.994995 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995614 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.995931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996087 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.996949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997711 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.997870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.998759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.998929 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.998929 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999540 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:56.999998 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.000924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001404 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001568 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.001873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.002794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003560 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.003867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004023 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.004853 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.005845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006421 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006731 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.006879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007328 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.007961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.008121 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.008269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.008424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.008763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.008943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009821 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.009983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010455 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.010897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011051 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.011874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.012814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013528 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.013845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.014638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.015610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.015758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.015927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.016993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017772 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.017936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.018092 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.018395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.018568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.018752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.019847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020002 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020316 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.020944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.021880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.022027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.022185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.022331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.022735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.022893 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023054 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.023995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.024150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.024844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.025122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.025298 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.025592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.025752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026186 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.026962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.027937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.028993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.029300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.029467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.029617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.029781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.030836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.030836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.031943 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032279 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.032940 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.033355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.033511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.033670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.033826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.033981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.034907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.035980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.036133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.036324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.036515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.036678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.036678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.037938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038390 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.038853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.039000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.039165 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.039470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.039637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.039795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.040667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.041103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.041351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.041601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.041860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.042132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.042423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.042663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.042925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.043181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.043455 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.043714 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.043917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.044903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.045983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.046908 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.047989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.048938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.049102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.049259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.049601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.049760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.049909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.050995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.051914 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052217 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.052842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053068 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.053860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054009 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054304 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054304 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.054873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055178 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055672 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055672 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.055962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056161 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.056977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057293 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.057893 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.058971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.059127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.059275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.059422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.059733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.059890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060049 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060660 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.060807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.061848 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.062925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063527 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.063852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064165 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064624 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.064950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.065886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066197 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.066989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067753 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.067909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068676 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.068842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.069619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.069949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.070109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.070264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.070413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.070627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.070845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.071125 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.071440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.071682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.071882 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072371 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072675 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.072823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.073962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074572 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074726 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.074884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075349 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.075965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.076949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.077892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078829 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.078978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.079124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.079277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.079435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.079583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.079731 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.080852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081182 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081340 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.081946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082272 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.082887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083041 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.083951 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.084870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.085824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.086123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.086270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.086417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.086571 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.087267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.087439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.087596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.087744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.087893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088050 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.088813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089152 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.089927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.090262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.090262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.090552 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.090716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.090879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091643 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.091878 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.092811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093180 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.093963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.094861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095168 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.095779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.096936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.098835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.100997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.102311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.104026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.105797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.106084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.106248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.106604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.106943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.107263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.107581 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.107900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.108221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.108552 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.108946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.109220 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.109536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.109857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.110173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.110602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.110903 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.111097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.111415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.111726 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.112040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.112351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.112662 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.112998 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.113316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.113634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.113949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.114261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.114574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.114886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.115198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.115557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.115895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.116222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.116555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.116895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.117253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.117576 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.117908 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.118286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.118611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.118933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.119285 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.119605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.119928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.120250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.120570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.120924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.121368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.121558 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.121943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.122204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.122546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.122874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.123205 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.123531 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.123851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.124192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.124516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.124840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.125339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.125532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.125854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.126180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.126498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.126820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.127146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.127471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.127817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.128500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.128826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.129821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.129821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.130138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.130293 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.130544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.130950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.131388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.131564 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.131823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:26:57.132139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:26:57.242484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO dbcounter [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Registered counter for database nova_api Jul 20 19:26:57.268647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_db.sqlalchemy.engines [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.276387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writer thread running {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.288862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO dbcounter [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Registered counter for database nova_api Jul 20 19:26:57.309693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.316427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writer thread running {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.334400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.context [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5483e977-c2fb-4c18-b67f-daecf8b173f5(cell1) {{(pid=117949) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:26:57.339252 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.340949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.341732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.343755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.345847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO dbcounter [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Registered counter for database nova_cell0 Jul 20 19:26:57.350141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO dbcounter [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Registered counter for database nova_cell1 Jul 20 19:26:57.357131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_db.sqlalchemy.engines [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.359725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_db.sqlalchemy.engines [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.363655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writer thread running {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.373766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.context [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5483e977-c2fb-4c18-b67f-daecf8b173f5(cell1) {{(pid=117948) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:26:57.377918 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.379524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.380336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.382652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.385227 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO dbcounter [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Registered counter for database nova_cell0 Jul 20 19:26:57.389263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO dbcounter [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Registered counter for database nova_cell1 Jul 20 19:26:57.398111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.401252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.406333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writer thread running {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.409469 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writer thread running {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.506953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writer thread running {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.518607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO dbcounter [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Registered counter for database nova_cell0 Jul 20 19:26:57.526267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_db.sqlalchemy.engines [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.530976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writer thread running {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.559215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO dbcounter [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Registered counter for database nova_cell0 Jul 20 19:26:57.566387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_db.sqlalchemy.engines [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:26:57.571198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writer thread running {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:26:57.861475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: WARNING keystonemiddleware.auth_token [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:26:57.869612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: WARNING keystonemiddleware.auth_token [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:26:57.897463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: WARNING keystonemiddleware.auth_token [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:26:57.904197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: WARNING keystonemiddleware.auth_token [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:26:58.225752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: WARNING keystonemiddleware.auth_token [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:26:58.232814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: WARNING keystonemiddleware.auth_token [None req-8a052d66-d97e-45af-8642-6c5ed86c60fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:26:58.239208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56343a5b29c0 pid: 117949 (default app) Jul 20 19:26:58.277202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: WARNING keystonemiddleware.auth_token [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:26:58.283504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: WARNING keystonemiddleware.auth_token [None req-d07d0ac7-dbf3-4331-bc30-2ddddb5b00ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:26:58.289719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56343a5b29c0 pid: 117948 (default app) Jul 20 19:27:39.881236 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:39.882172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:39.883261 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:39.884298 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:40.973364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5a243c15-76cc-45e3-9f68-3851d727c2c8 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Action: 'create', calling method: .version_select at 0x7f0e87c8ad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-231247079", "metadata": {"Type": "work"}}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5a243c15-76cc-45e3-9f68-3851d727c2c8 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 121 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:27:40.998461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-231247079", "metadata": {"Type": "work"}}} Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: Jul 20 19:27:41.000202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-231247079', 'metadata': {'Type': 'work'}}}} Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:41.001189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:27:41.003378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:27:41.004734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:27:41.004734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.004734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5a243c15-76cc-45e3-9f68-3851d727c2c8 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:41.004734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5a243c15-76cc-45e3-9f68-3851d727c2c8 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.136219 Jul 20 19:27:41.004734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 19:27:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:27:41.017496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:41.018445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:41.019257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:41.020510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:41.263707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7ccd6959-af48-440f-8343-6a927d2c5c12 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Action: 'create', calling method: .version_select at 0x7f0e87c69790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-306481969", "metadata": {"Type": "work"}}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7ccd6959-af48-440f-8343-6a927d2c5c12 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 119 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:27:41.270822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-306481969", "metadata": {"Type": "work"}}} Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:27:41.272329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-306481969', 'metadata': {'Type': 'work'}}}} Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi '0' Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:41.273778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:27:41.276359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:27:41.277898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:27:41.277898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.277898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7ccd6959-af48-440f-8343-6a927d2c5c12 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:41.277898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7ccd6959-af48-440f-8343-6a927d2c5c12 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.262692 Jul 20 19:27:41.277898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 1/2] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 19:27:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 19:27:41.285549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5bafb614-c623-4b29-82d6-b82d54a6a6a7 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Action: 'create', calling method: .version_select at 0x7f0e87b4a040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1650717422", "metadata": {"Type": "work"}}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5bafb614-c623-4b29-82d6-b82d54a6a6a7 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 119 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:27:41.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1650717422", "metadata": {"Type": "work"}}} Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: Jul 20 19:27:41.291463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1650717422', 'metadata': {'Type': 'work'}}}} Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi '' Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:41.292313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:27:41.293888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:27:41.295194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:27:41.295194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:41.297017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5bafb614-c623-4b29-82d6-b82d54a6a6a7 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:41.298182 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5bafb614-c623-4b29-82d6-b82d54a6a6a7 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017065 Jul 20 19:27:41.299402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 19:27:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:27:41.312244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-44dbea0e-6a3c-40bf-a0b7-9043f382fbae tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Calling method '.version_select at 0x7f0e87bed940>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:42.462942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-44dbea0e-6a3c-40bf-a0b7-9043f382fbae tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] HTTP exception thrown: Volume tempest-invalid-898177766 could not be found. Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-44dbea0e-6a3c-40bf-a0b7-9043f382fbae tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-898177766 HTTP/1.1 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:27:42.467219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Volume tempest-invalid-898177766 could not be found. Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'tempest-invalid-898177766'} Jul 20 19:27:42.469033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-898177766 could not be found. (HTTP 404) (Request-ID: req-e0b5d50c-ba10-4b71-bbaf-2d917c849eb0) Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:42.470046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:27:42.471602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-898177766 could not be found. Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:27:42.473076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-898177766 could not be found. Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-898177766 could not be found. Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-44dbea0e-6a3c-40bf-a0b7-9043f382fbae tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 404 to user: Volume tempest-invalid-898177766 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-44dbea0e-6a3c-40bf-a0b7-9043f382fbae tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-898177766" status: 404 len: 98 microversion: 2.1 time: 1.161912 Jul 20 19:27:42.477130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1214 bytes} [Wed Jul 20 19:27:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-898177766 => generated 98 bytes in 1167 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 19:27:42.479635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f650efe0-cf6f-4c58-b317-fd7f6d294b13 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004579 Jul 20 19:27:42.480560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 19:27:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 19:27:42.491873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cea06605-9135-404a-8742-587e736d867d tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005783 Jul 20 19:27:42.492380 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 3/6] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 19:27:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 19:27:42.513388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c2e0ea3a-2a7c-4068-9dda-7bb9af05f4b2 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Calling method '.version_select at 0x7f0e87c8adc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:43.143125 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-c2e0ea3a-2a7c-4068-9dda-7bb9af05f4b2 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] HTTP exception thrown: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c2e0ea3a-2a7c-4068-9dda-7bb9af05f4b2 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: DELETE /compute/v2.1/os-volumes/92457981-7cc6-4dff-bed6-01af5ca9b002 HTTP/1.1 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:27:43.147610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '92457981-7cc6-4dff-bed6-01af5ca9b002'} Jul 20 19:27:43.149174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. (HTTP 404) (Request-ID: req-4b46fff7-684c-492d-bd01-a31a7b737480) Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.149974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:27:43.151066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:27:43.152114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c2e0ea3a-2a7c-4068-9dda-7bb9af05f4b2 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 404 to user: Volume 92457981-7cc6-4dff-bed6-01af5ca9b002 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c2e0ea3a-2a7c-4068-9dda-7bb9af05f4b2 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/92457981-7cc6-4dff-bed6-01af5ca9b002" status: 404 len: 109 microversion: 2.1 time: 0.645730 Jul 20 19:27:43.154574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:27:42 2022] DELETE /compute/v2.1/os-volumes/92457981-7cc6-4dff-bed6-01af5ca9b002 => generated 109 bytes in 650 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:27:43.162874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b480c1f6-069a-4f5e-b623-373d25d81903 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Calling method '.version_select at 0x7f0e87a6f820>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:43.235682 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-b480c1f6-069a-4f5e-b623-373d25d81903 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] HTTP exception thrown: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b480c1f6-069a-4f5e-b623-373d25d81903 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Request method failure captured: Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/os-volumes/2c48bbc5-ef07-40da-a808-93b16c9fe4b0 HTTP/1.1 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FcrWy3T4-3SWzPs9D7ZyMsppSzDdyyKGk2GJ5s79C7YIvdbyFWd3O6eMODKAWrqvxYrkBCe2tjS8kp_fnREOMLY3Nl7b7zIpR6KKlAM9IY28vEgptUVIw0GwcGrR656Txz5V1EtZaJ2ZGSgFB3SUnGO2k31g9V6aHvTmQUV2rTn75M Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:27:43.237716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_509e9c4cf31b4e9ea9d42a7bc4b99ac3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/509e9c4cf31b4e9ea9d42a7bc4b99ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 509e9c4cf31b4e9ea9d42a7bc4b99ac3 Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesNegativeTest-1852721966 Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: b853c55a3b6f4f2cb7dc6dc68cb64826 Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesNegativeTest-1852721966-project Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '2c48bbc5-ef07-40da-a808-93b16c9fe4b0'} Jul 20 19:27:43.239072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. (HTTP 404) (Request-ID: req-609688a7-0228-4ca6-8786-beddb6b25c26) Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.239852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:27:43.241131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:27:43.242277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b480c1f6-069a-4f5e-b623-373d25d81903 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] Returning 404 to user: Volume 2c48bbc5-ef07-40da-a808-93b16c9fe4b0 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b480c1f6-069a-4f5e-b623-373d25d81903 tempest-VolumesNegativeTest-1852721966 tempest-VolumesNegativeTest-1852721966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/2c48bbc5-ef07-40da-a808-93b16c9fe4b0" status: 404 len: 109 microversion: 2.1 time: 0.081760 Jul 20 19:27:43.243473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:27:43 2022] GET /compute/v2.1/os-volumes/2c48bbc5-ef07-40da-a808-93b16c9fe4b0 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:27:59.811055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2112575553", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "networks": [{"uuid": "8f25a6a9-71a3-40d2-8ab0-9ea53e7b1697"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:00.118148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] validate_networks() for [('8f25a6a9-71a3-40d2-8ab0-9ea53e7b1697', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:00.938317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f1ecee30-6418-4ea2-91f2-99929be671ff tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: .version_select at 0x7f0e87a6f9d0>, body: {"keypair": {"name": "tempest-keypair-1275749067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRwuaxaWFQ7jFwBlQ1eDcX52Pi4xGcQF/t+UKdGnoVxMHIEiUOa5RJhCQOmoJwiSzSBPnC3oBUYUGo13aDXYeZmWH+3TKyvgbjo2pVW5KxvrPjvcdsjCel5I0hFY7fcww=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:01.136230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-f1ecee30-6418-4ea2-91f2-99929be671ff tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:01.147646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-f1ecee30-6418-4ea2-91f2-99929be671ff tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for user 3f7758d298f642138b71aa422d0344da and project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:01.329951 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f1ecee30-6418-4ea2-91f2-99929be671ff tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.717083 Jul 20 19:28:01.334817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 5/9] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:27:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:03.067169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:03.067759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:03.068449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:03.069001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:03.069654 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:03.113181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-44c9bf75-e21b-4c52-b669-6068d88e46e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: .version_select at 0x7f0e879dd280>, body: {"keypair": {"name": "tempest-keypair-1923695319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClvF37Rh3nPNFS9WC1wu/0SaJTL9zjRkv+9TW6oDngFHN2n0XpapWsPxXKRAII2sBK+OBOWs5V26ROc6QfhcFoR0o7jbb8x1JiDpILJ5s3Vei+LA4P0W8dLDIn7hpL2lg=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:03.120818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:03.131841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:03.133757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:03.136803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:03.211615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-44c9bf75-e21b-4c52-b669-6068d88e46e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for project ca9f11498f9d4245910281ac3bd55470. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:03.249334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-44c9bf75-e21b-4c52-b669-6068d88e46e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for user c18c8d4034ce40dba9f9f48e96a19814 and project ca9f11498f9d4245910281ac3bd55470. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:03.295371 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Getting quotas for project 183d6a3ee79e4fedb83591ce60694283. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:03.297316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-44c9bf75-e21b-4c52-b669-6068d88e46e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.176778 Jul 20 19:28:03.297994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 6/10] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 19:28:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 19:28:03.312120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Getting quotas for user a271ea90c6884817991aaa9e8be36cab and project 183d6a3ee79e4fedb83591ce60694283. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:03.355667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:03.365798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:03.579142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-62273242-4fb7-4b53-9fdc-022d3f31f647 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.537326 Jul 20 19:28:03.582416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 5/11] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:28:03.594768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e159be2c-1273-478f-8093-c62b3794a881 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:03.599131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e159be2c-1273-478f-8093-c62b3794a881 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:04.069223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e159be2c-1273-478f-8093-c62b3794a881 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:04.094515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e159be2c-1273-478f-8093-c62b3794a881 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1215 microversion: 2.1 time: 0.503754 Jul 20 19:28:04.095849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 7/12] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:03 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1215 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:05.048975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1087925168", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:05.113975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fc5d6a33-ea8a-452a-92f8-96cf8938b675 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:05.114703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fc5d6a33-ea8a-452a-92f8-96cf8938b675 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:05.262442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] validate_networks() for [('2deda7b4-dab0-4eb8-8cde-830d55ad6ecc', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:05.356188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fc5d6a33-ea8a-452a-92f8-96cf8938b675 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:05.380368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fc5d6a33-ea8a-452a-92f8-96cf8938b675 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1215 microversion: 2.1 time: 0.258633 Jul 20 19:28:05.381690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 8/13] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:05 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:06.397967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d118f7d3-8262-4ea0-9c14-0e806525ad9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:06.399147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d118f7d3-8262-4ea0-9c14-0e806525ad9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:07.698092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d118f7d3-8262-4ea0-9c14-0e806525ad9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:07.707085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d118f7d3-8262-4ea0-9c14-0e806525ad9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1215 microversion: 2.1 time: 1.312282 Jul 20 19:28:07.717131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 9/14] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:06 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1215 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:08.193407 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1041168824", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f233501-5abf-42f7-9923-d5c098fbf3c6"}], "security_groups": [{"name": "tempest-securitygroup--1707478449"}], "key_name": "tempest-keypair-1275749067", "user_data": "}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:08.404394 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:08.404952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:08.405313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:08.405717 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:08.406312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:08.442735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.443204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.444158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.444655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.472048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:08.483748 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for user 347106fdd7c94624ab9d40b51da78623 and project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:08.498264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:08.500529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:08.575593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bf9cc2c1-9dc7-418b-8432-26d4145234fe tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.428421 Jul 20 19:28:08.581549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 6/15] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:28:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 4435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:28:08.595538 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-02743fa1-3b63-4d58-97eb-72953d9e2e38 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:08.596571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-02743fa1-3b63-4d58-97eb-72953d9e2e38 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:08.715593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-02743fa1-3b63-4d58-97eb-72953d9e2e38 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:08.718044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] validate_networks() for [('1f233501-5abf-42f7-9923-d5c098fbf3c6', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:08.747923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-02743fa1-3b63-4d58-97eb-72953d9e2e38 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1222 microversion: 2.1 time: 0.159112 Jul 20 19:28:08.749549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 7/16] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:08 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:08.769781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:08.770412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:08.782615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.783491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.786271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.787961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:09.291713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:09.311726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b609aee7-e2c5-475c-a2c9-54ff4d15d618 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1219 microversion: 2.1 time: 0.561048 Jul 20 19:28:09.317045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:08 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1219 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:09.332584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-827798874", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:09.456791 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] validate_networks() for [('2deda7b4-dab0-4eb8-8cde-830d55ad6ecc', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:11.238192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:11.238854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:11.239432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:11.240181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:11.240533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:11.252511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:11.253234 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:11.254132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:11.254753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:11.255284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:11.285875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.287664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.290049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.291856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.292461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.293225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.294688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.298349 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.373904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:11.382786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for user 3f7758d298f642138b71aa422d0344da and project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:11.417400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:11.425611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:11.429345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:11.430731 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for user 347106fdd7c94624ab9d40b51da78623 and project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:11.477306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:11.483657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:11.636382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-27dd105e-baab-4391-830b-907e1cf47523 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.310192 Jul 20 19:28:11.639536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 9/18] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:28:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:28:11.650651 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ca121af3-67e8-41c9-aef4-d28d980c6db8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.467741 Jul 20 19:28:11.651893 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 10/19] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:28:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 3470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:28:11.661779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:11.664833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-357650544", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c252680c-c029-4238-80e1-835b5a8591d8"}], "security_groups": [{"name": "tempest-securitygroup--769656589"}], "key_name": "tempest-keypair-1923695319", "user_data": "}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:11.665764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:11.684573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.686110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.692017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.692802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.098619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.120238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-14e4792b-71f1-4e0d-bc37-c76cb66410c8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1275 microversion: 2.1 time: 0.474367 Jul 20 19:28:12.121968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 10/20] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:11 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:12.172093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cb76b11a-cfc8-45a8-8927-dad014f73b4f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:12.183106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cb76b11a-cfc8-45a8-8927-dad014f73b4f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.266638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] validate_networks() for [('c252680c-c029-4238-80e1-835b5a8591d8', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:13.200762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cb76b11a-cfc8-45a8-8927-dad014f73b4f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:13.219613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cb76b11a-cfc8-45a8-8927-dad014f73b4f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1221 microversion: 2.1 time: 1.096043 Jul 20 19:28:13.229128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 11/21] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:12 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1221 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:13.235795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:13.236642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:13.273216 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.277122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:13.280684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.284033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:13.821151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:13.835117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2e2136cb-c7f1-4a0a-b133-234dc5a0e385 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1242 microversion: 2.1 time: 0.604457 Jul 20 19:28:13.839399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 12/22] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:13 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1242 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:13.859251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:13.859882 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:13.881124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.883781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:13.888070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.890286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.205001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.221856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-67082f20-a4f4-4be1-abb6-00ce92daad04 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1273 microversion: 2.1 time: 0.381290 Jul 20 19:28:14.227252 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 13/23] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:13 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1273 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:14.243631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:14.251942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:14.285868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.291925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.293621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.294170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.532681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.560673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1e60dd01-ee65-4db9-a728-7e54c461c7ff tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1273 microversion: 2.1 time: 0.313237 Jul 20 19:28:14.563786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 14/24] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:14 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:14.860417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:14.861621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:14.878682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.880643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.884078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.886671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.259251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:15.271380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1d90345d-3c99-4b96-a227-5894cfb21441 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1290 microversion: 2.1 time: 0.415521 Jul 20 19:28:15.272395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 15/25] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:14 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1290 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:15.301656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:15.303414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:15.338307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.341758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.344268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.347855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.615849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:15.624511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-56435c11-3a1f-4f96-9d9b-37de2500ff8c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1273 microversion: 2.1 time: 0.350630 Jul 20 19:28:15.628518 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 16/26] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:15 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:15.643634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:15.649346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:15.672292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.674714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.675670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.676187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.186810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.215325 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-60837dbb-a274-4ccc-b6a2-f7a6d846ddf3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1291 microversion: 2.1 time: 0.569160 Jul 20 19:28:16.216202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 17/27] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:15 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1291 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:16.291341 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:16.292841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:16.308012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.309123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.313655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.314389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.425478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:16.427388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:16.428419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:16.430026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:16.430920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:16.443762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.444557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.445656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.446322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.473453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for project ca9f11498f9d4245910281ac3bd55470. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:16.479154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for user c18c8d4034ce40dba9f9f48e96a19814 and project ca9f11498f9d4245910281ac3bd55470. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:16.494340 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:16.496801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:16.501618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.514565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-facedd26-6722-4e12-81c1-6ce0f3c301cb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1298 microversion: 2.1 time: 0.225210 Jul 20 19:28:16.515745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 18/28] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:16 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:16.584056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-337894f7-7b38-4f45-93da-236d95a8cb5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.928727 Jul 20 19:28:16.586447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 11/29] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 19:28:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 4934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 19:28:16.603962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:16.604663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:16.645762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:16.648642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:16.660808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.662084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.663494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.665245 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.799766 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.813817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.815713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.832335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-45bcc793-b176-4039-83d2-ba0e19e84aaf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1281 microversion: 2.20 time: 0.236163 Jul 20 19:28:16.844505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 19/30] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:16 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1281 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:17.219871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.234184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:17.234909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:17.237026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-29ba5454-0ed1-4ddc-a386-29d06834b1de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.595870 Jul 20 19:28:17.239118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 12/31] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:16 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:17.242479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.243690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.244716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.245403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.326073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.334543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f693b32f-c563-4d1d-806a-44bd79d4f737 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1291 microversion: 2.1 time: 0.104922 Jul 20 19:28:17.335648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 20/32] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:17 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1291 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:17.532683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:17.533357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:17.541357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.541831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.542615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.543060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.615736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.625003 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c504ed5e-16c7-4ee6-9170-c6cc1e81b96b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1298 microversion: 2.1 time: 0.096242 Jul 20 19:28:17.625691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 13/33] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:17 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:17.850446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:17.851275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:17.857605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.858049 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.858846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.859274 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.934971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.945205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.947220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:17.948739 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8d58c7b0-9965-40d8-83d7-4cd1e76c77c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1285 microversion: 2.20 time: 0.102114 Jul 20 19:28:17.949789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 21/34] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:17 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:18.256287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:18.258222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:18.267053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.267481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.268216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.268663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.379976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:18.388934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:18.400853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.402555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.403605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.404271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.556795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:18.565221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-171150dd-e2c9-462a-8a8f-305cd3c66c0d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.312684 Jul 20 19:28:18.594263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 14/35] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:18 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:18.642781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:18.643777 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:18.655098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.655561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.658231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.658231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.666875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:18.681105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f1360f95-7d3b-4e4a-8f8d-12726e641bce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1291 microversion: 2.1 time: 0.330048 Jul 20 19:28:18.683795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 22/36] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:18 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1291 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:18.758500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:18.774312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5ecc3442-14c8-4d1b-945a-f7f743cdea77 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1298 microversion: 2.1 time: 0.130648 Jul 20 19:28:18.788430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 15/37] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:18 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:18.967677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:18.968584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:18.980756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.982980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:18.985677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:18.987846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:19.195259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:19.216132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:19.222981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:19.229033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-93a73328-ddf1-4f29-9f20-a2133cdd9f17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1285 microversion: 2.20 time: 0.265445 Jul 20 19:28:19.233835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 23/38] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:18 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:19.624640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:19.625831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:19.642375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:19.643749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:19.647342 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:19.647846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:19.711133 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:19.712941 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:19.747095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:19.749521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:19.759704 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:19.761416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.085596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.111910 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-48b632ae-fa1a-4ddf-afd9-6d5f4758f67a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1279 microversion: 2.1 time: 0.405162 Jul 20 19:28:20.118549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 24/39] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:19 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1279 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:20.134463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:20.146888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:20.173453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.177491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.181462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.185362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.407376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.417131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1e2ebcb8-4f81-48b0-939d-ffc6034e41fa tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.799266 Jul 20 19:28:20.429084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 16/40] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:19 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:20.448170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:20.456861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:20.466197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.467236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.468513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:20.469483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:20.646780 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.666152 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-179e0260-af13-4d8b-9328-89b5c4705344 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.539715 Jul 20 19:28:20.666907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 25/41] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:20 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:20.740807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.762399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.764079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:20.765253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-abd83049-08f8-4950-badc-c46ddb5829d0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1333 microversion: 2.20 time: 0.334696 Jul 20 19:28:20.777556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 17/42] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:20 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1333 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:21.139332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:21.139332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:21.143884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.146244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.148940 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.150435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.188133 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:21.341319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:21.434958 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:21.436029 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:21.445394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.445887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.446728 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.447241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.498190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:21.521878 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-eb27f1b2-f91f-4a04-a248-0e9ab0c5103d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.393791 Jul 20 19:28:21.522997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 26/43] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:21 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:21.686128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:21.687063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:21.697252 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.701536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.703273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.703968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.821224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:21.832383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ec5e79f7-70d7-43f4-8197-c34a63fc5e9b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.150665 Jul 20 19:28:21.833383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 27/44] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:21 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:21.839651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:21.840725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:21.849969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.851889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.853395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:21.854671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:21.878930 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:21.893483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-654f1c77-c436-4e10-b348-0efcf9417b95 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.462198 Jul 20 19:28:21.904642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 18/45] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:21 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:21.973930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:22.001369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:22.009160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:22.010471 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e735bc88-8f63-4f2f-befd-e045dc3b3eb8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1341 microversion: 2.20 time: 0.175130 Jul 20 19:28:22.011151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 28/46] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:21 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:22.015742 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-560af0de-d154-4595-a03b-9e9439b17034 req-b12caea7-7ea6-44d6-b086-a7ef2547a2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "199315e6-e6f0-4c28-b63f-40ec5e5bef49", "tag": "7da85c79-f873-46d3-99dc-20d26d7d7408"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:22.033533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-560af0de-d154-4595-a03b-9e9439b17034 req-b12caea7-7ea6-44d6-b086-a7ef2547a2e5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.035242 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-560af0de-d154-4595-a03b-9e9439b17034 req-b12caea7-7ea6-44d6-b086-a7ef2547a2e5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.059258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-560af0de-d154-4595-a03b-9e9439b17034 req-b12caea7-7ea6-44d6-b086-a7ef2547a2e5 service nova] Creating event network-changed:7da85c79-f873-46d3-99dc-20d26d7d7408 for instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 on hv-cinder-85054 Jul 20 19:28:22.060781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-560af0de-d154-4595-a03b-9e9439b17034 req-b12caea7-7ea6-44d6-b086-a7ef2547a2e5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:28:22.062141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.062795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.063828 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.064475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.086767 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.compute.rpcapi [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:28:22.099020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] Releasing lock "compute-rpcapi-router" {{(pid=117948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:28:22.119818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f1935fe5-da10-46f7-86af-e8f2bf45c030 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201259 Jul 20 19:28:22.121406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 19/47] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:22.527913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-6f03d665-c11e-4864-96a7-bdd4ab3a79b3 req-de669ea2-ce18-455d-b5e3-cabf22004e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e030ad0-4549-4070-bf06-563e23b2dce5", "tag": "a2c254e5-f31b-4788-9fa7-0f9ebfad4218"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:22.543598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:22.544206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:22.544606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6f03d665-c11e-4864-96a7-bdd4ab3a79b3 req-de669ea2-ce18-455d-b5e3-cabf22004e09 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.545094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6f03d665-c11e-4864-96a7-bdd4ab3a79b3 req-de669ea2-ce18-455d-b5e3-cabf22004e09 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.550629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.551372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.552163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.552605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.569898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-6f03d665-c11e-4864-96a7-bdd4ab3a79b3 req-de669ea2-ce18-455d-b5e3-cabf22004e09 service nova] Creating event network-changed:a2c254e5-f31b-4788-9fa7-0f9ebfad4218 for instance 0e030ad0-4549-4070-bf06-563e23b2dce5 on hv-cinder-85054 Jul 20 19:28:22.570727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6f03d665-c11e-4864-96a7-bdd4ab3a79b3 req-de669ea2-ce18-455d-b5e3-cabf22004e09 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:28:22.572468 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.573097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.574215 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.574836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.589237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.compute.rpcapi [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:28:22.590129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] Releasing lock "compute-rpcapi-router" {{(pid=117949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:28:22.610516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cfeb417f-e39c-485e-a247-c93277d0c735 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150784 Jul 20 19:28:22.611530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 29/48] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:22.719886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:22.728005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8e424210-44e5-42d9-aa1a-1113fdaa8bd0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.192066 Jul 20 19:28:22.728671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 20/49] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:22 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:22.850314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:22.851369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:22.854405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:22.858519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.858971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.859748 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.860186 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.911161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:22.911867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:22.918301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.918833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.919855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:22.920574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:22.930354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:22.939521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-42264502-d6e4-49d1-bc3d-c498b06f6ebd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.093183 Jul 20 19:28:22.940724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 30/50] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:22 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:23.030510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:23.031616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:23.038847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.039346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.040411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.040993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.074186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:23.081923 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-52da9d60-392d-4453-bcb5-81cca64a6865 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.175122 Jul 20 19:28:23.082504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 21/51] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:22 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:23.110746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:23.119705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:23.121470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:23.122576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7d08aa92-5099-41e4-bed7-3af51e8139d9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1341 microversion: 2.20 time: 0.096294 Jul 20 19:28:23.123175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 31/52] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:23 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:23.746396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:23.747313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:23.754840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.755537 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.756720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.757492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.957462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:23.958801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:23.968466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.969430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.970801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.971446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.011870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.023292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-38199af5-9e1f-4eee-8152-aefcb53d0a23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.280589 Jul 20 19:28:24.024619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 22/53] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:23 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:24.070899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.080561 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-498e9495-8793-44c0-aece-1ea3acffdced tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.127208 Jul 20 19:28:24.081508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 32/54] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:23 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:24.102961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:24.103769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:24.110443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.111410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.112351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.113048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.141853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:24.142716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:24.157843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.158289 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.159324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.159763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.300189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.321664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.323639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.325200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-115ecd0a-129b-429f-9920-62b9ea5563bc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.187200 Jul 20 19:28:24.326129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 33/55] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:24 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:24.369680 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.379995 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cf22332b-eaff-4c96-b6ba-91cabbf5cbf8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.281559 Jul 20 19:28:24.380672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 23/56] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:24 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:25.040792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:25.041475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:25.047661 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.048334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.049335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.049769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.099610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:25.100940 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:25.107219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.107763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.108624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.109107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.220462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.229731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b40ef8e2-dc0b-4d3a-82ce-809c00d0c09c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.133966 Jul 20 19:28:25.230322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 24/57] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:25 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:25.261711 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.270656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c432e265-ccf6-4d81-89c9-5cc6997ed2bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.234168 Jul 20 19:28:25.271238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 34/58] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:25 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:25.349480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:25.350318 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:25.354457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:25.363806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.364450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.365472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.366125 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.402878 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:25.403977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:25.414474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.414930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.415911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.416355 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.517842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.526957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.555061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.563156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ae5c3e01-c4d9-499e-a4a9-3c1bab466f05 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.217914 Jul 20 19:28:25.563906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 25/59] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:25 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:25.671755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.688170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-98955ce7-acc8-4c6e-b022-b1de0728c00a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.292050 Jul 20 19:28:25.690790 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 35/60] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:25 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:26.249294 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.249960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.257719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.258265 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.259064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.259505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.291381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.292204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.299205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.300067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.300842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.301292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.349683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.359924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3396bd3c-0149-4e1f-9cc0-8f5167bbb634 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.115904 Jul 20 19:28:26.360501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 26/61] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:26.525327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.537063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-04e39655-258a-41c7-abab-a52eeda8ae9c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.250106 Jul 20 19:28:26.537759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 36/62] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:26.582113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.582723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.584605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=26 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:26.590391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.590846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.591628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.592233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.669729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.678194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.681237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.682375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f3ebadf6-1f50-4e8e-8ec5-1050b98a2199 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.104319 Jul 20 19:28:26.682940 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 27/63] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:26.709035 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.710183 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.716317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.716738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.717545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.717977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.809896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=24 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:26.862067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.870666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9e1f971a-ef6f-4875-a69f-33718c31ffe8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.165447 Jul 20 19:28:26.871250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 37/64] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:27.377354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:27.378007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:27.384868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.385353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.386140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.386586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.391316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:27.456230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.465060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-de8f08cf-782d-40f0-9df8-f4937ba5a9d6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.091449 Jul 20 19:28:27.465643 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 28/65] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:27 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:27.559241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:27.559848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:27.565961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.566406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.567156 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.567583 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.700935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:27.701633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:27.704771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.708340 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.709016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.710103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.710770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.713970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2ed2f9af-9133-4218-bd88-56df18dbaf35 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.158354 Jul 20 19:28:27.721760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 38/66] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:27 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:27.792134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.800515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.801978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.803105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-512d116d-8cd9-4f7e-8346-6d815e188f73 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.106118 Jul 20 19:28:27.804357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 29/67] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:27 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:27.887738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:27.888353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:27.894537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.894994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.895763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.896197 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.064670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.072514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-15cabcd0-f48d-4a68-9216-74ff1e65e32e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.188588 Jul 20 19:28:28.073463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 39/68] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:27 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:28.487887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:28.489188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:28.503483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.503942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.504736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.505206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.586378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.602301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-45c2af2d-07a8-4a30-a114-bddaab1c0c14 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.118394 Jul 20 19:28:28.603093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 30/69] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:28 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:28.739633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:28.740245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:28.746961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.747411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.748172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.748607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.834582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:28.835447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:28.842120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.842576 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.843561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.844197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.928144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.932612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.937814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.939705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.940093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7713a43c-397d-473e-9751-db808e1c4aaa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.204362 Jul 20 19:28:28.940678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 40/70] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:28 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:28.940982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f80bd70f-f1fa-4495-b0e0-bca1ee231301 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.120064 Jul 20 19:28:28.941613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 31/71] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:28 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:29.090882 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.091502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.097814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.098270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.099315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.099631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.243422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:29.250779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fb2c3cb1-1cfb-4801-bbda-c9ad9b55d84d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.164221 Jul 20 19:28:29.251347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 41/72] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:29.620603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.621251 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.627443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.627896 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.628673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.629140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.708692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:29.718468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-89cb7a25-6930-4fc8-8246-e4ff3177f95e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.102251 Jul 20 19:28:29.719031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 32/73] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:29.957793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.958358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.964922 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.965647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.966101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.966265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.967043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.967713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.972319 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.972774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.973708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.974215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.061460 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.071086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.072618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.073754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c2a3723a-f03d-45cf-b9f6-0f4087dc2b89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.112749 Jul 20 19:28:30.074538 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 33/74] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:30.125185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.133719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fc0543c8-e8bf-4c37-a9ac-c6503757d12d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.179868 Jul 20 19:28:30.134324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 42/75] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:30.269645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:30.270171 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:30.276833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.277312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.278075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.278517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.409099 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.417695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b2062934-de3e-46e9-9990-a1ecfa356d9a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.151994 Jul 20 19:28:30.418268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 34/76] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:30 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:30.735342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:30.735925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:30.742041 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.742634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.743394 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.743899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.765977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:30.811320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.818715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-daf0836d-dd5e-48f8-bc15-5ebc2929245e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.087408 Jul 20 19:28:30.819373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 43/77] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:30 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:31.092027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.092870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.099021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.099544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.100378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.100904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.152088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.152832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.159109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.159561 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.160319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.160753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.164584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.172693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.174248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.175349 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2d4d6ed4-ef3d-49de-b096-b008589d3e66 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1351 microversion: 2.20 time: 0.087261 Jul 20 19:28:31.175904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 35/78] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:31.295721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.303192 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-738f33fc-e303-43d6-a848-4caa05469d58 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.156557 Jul 20 19:28:31.304557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 44/79] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:31.435155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.435780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.442117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.442709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.443685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.445117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.605313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.615471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-52ec9fbe-32a6-4021-97b8-fb69015498a7 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.184059 Jul 20 19:28:31.616792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 36/80] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:31.838122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.839070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.853327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.853721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.854914 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.855102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.980486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.992914 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c9975580-b9c9-4aa0-bcaa-23edaf646c23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1296 microversion: 2.1 time: 0.161314 Jul 20 19:28:31.994270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 45/81] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:32.195385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:32.196013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:32.209280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:32.214060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.214978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.216120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.216812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.323752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:32.324897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:32.332284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.332822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.334113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.334672 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.494051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.513530 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.517703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.520060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1d74bd6b-97f1-448a-81c2-bfb04ca2e0fd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1339 microversion: 2.20 time: 0.330544 Jul 20 19:28:32.545149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 37/82] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:32 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1339 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:32.589423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:32.599166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-44a2d444-f9c7-49c9-afeb-4f5f64644e97 req-538d9ab8-9e06-401a-8e09-b89ace9b7e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a52396-c000-4931-8896-46dcf99d449a", "tag": "a6b0ac08-0caa-47dc-9d21-4afca1983d3b"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:32.612107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-44a2d444-f9c7-49c9-afeb-4f5f64644e97 req-538d9ab8-9e06-401a-8e09-b89ace9b7e06 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.612858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-44a2d444-f9c7-49c9-afeb-4f5f64644e97 req-538d9ab8-9e06-401a-8e09-b89ace9b7e06 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.638452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-44a2d444-f9c7-49c9-afeb-4f5f64644e97 req-538d9ab8-9e06-401a-8e09-b89ace9b7e06 service nova] Creating event network-changed:a6b0ac08-0caa-47dc-9d21-4afca1983d3b for instance a0a52396-c000-4931-8896-46dcf99d449a on hv-cinder-85054 Jul 20 19:28:32.649166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-44a2d444-f9c7-49c9-afeb-4f5f64644e97 req-538d9ab8-9e06-401a-8e09-b89ace9b7e06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051147 Jul 20 19:28:32.652115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 38/83] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:32.659844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:32.660740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:32.668616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.676864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cc9efd48-72d6-4087-97d1-33972819d549 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.358930 Jul 20 19:28:32.677655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 46/84] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:32 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:32.681420 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.683877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.684934 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.685516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.948062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.955748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-729960b7-ccc2-4101-9fdd-66ea7464b5de tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.302335 Jul 20 19:28:32.956337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 39/85] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:32 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:33.010792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.011398 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.020605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.021402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.023157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.023970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.159061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.167118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4c72e3c5-82a7-4081-9910-1ebc0e6885f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.161078 Jul 20 19:28:33.167696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 47/86] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:33.539742 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.540448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.547056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.547510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.548278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.548728 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.696521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.697178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.704855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.705834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.706715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.707217 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.722157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.737509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.740282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.742459 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b4f1c444-f2dd-45aa-ac65-3b01a0d1f6d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.208415 Jul 20 19:28:33.743456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 40/87] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:33.854619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.862208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8fdc1b5d-365d-4747-bb02-6a7eead1170e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.170897 Jul 20 19:28:33.872421 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 48/88] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:33.972985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.974098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.981378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.981834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.982616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.983055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.119894 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:34.127579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9b26850f-31a4-4a87-9054-97b37f281fb8 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.159044 Jul 20 19:28:34.128155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 41/89] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:34.184705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:34.185433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:34.191765 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.192349 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.193396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.193929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.329271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:34.337259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7ca97e7f-5ed2-4dd1-9bc5-8ce0f8337097 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.156367 Jul 20 19:28:34.337860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 49/90] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:34 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:34.761899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:34.762503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:34.768702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.769185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.770041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.770434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.880018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:34.880633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:34.887943 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.888396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.889399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.889844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.209208 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.222492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.224152 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.226015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-da5d2b81-d064-40f1-998d-c15f4fffda34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.468774 Jul 20 19:28:35.226452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 42/91] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:34 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:35.231690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:35.232933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:35.240163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.240618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.242645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.243249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.405479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.415001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-85cfb412-ae59-45b3-a498-63483b4874d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.538741 Jul 20 19:28:35.416283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 50/92] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:34 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:35.428209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:35.429176 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:35.435966 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.436545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.437549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.438087 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.014466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.046909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3cfc2834-7f5c-4258-9743-0f32011580bf tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.815405 Jul 20 19:28:36.060821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 43/93] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:35 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:36.071816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.086064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e0ff972d-ba9a-40de-9261-2ee7fcfdab08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.663598 Jul 20 19:28:36.086870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 51/94] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:35 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:36.245130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:36.246612 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:36.255712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.256252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.258175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.258691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.432102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:36.436964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:36.443541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.444956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.446309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.446971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.888369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.903488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-581cecaf-0b02-4195-ba8b-ca4037e962ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.475727 Jul 20 19:28:36.904351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 52/95] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:36 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:36.932743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.945906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.952491 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.954046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9f4fba20-f885-4cd7-b8df-7ae6eeb54798 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.713736 Jul 20 19:28:36.955321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 44/96] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:36 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:37.064146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.065223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.072310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.077573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.078676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.080067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.105693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.131639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.147214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.148708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.150702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.151523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.300441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:37.582051 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:37.590721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-edf53680-a634-4ce5-8c2d-b84cfa781dd1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.530330 Jul 20 19:28:37.591305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 53/97] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:37.595807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-0fd94033-3de5-4f51-b22b-f1bf46a419a6 req-49cb9539-994e-4a61-ad3b-7e0e635151f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05854927-1ff5-4246-9509-c677fbb0a9f2", "tag": "d840dfba-98a6-425f-b11b-365b0749db34"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:37.604323 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-0fd94033-3de5-4f51-b22b-f1bf46a419a6 req-49cb9539-994e-4a61-ad3b-7e0e635151f4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.604759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-0fd94033-3de5-4f51-b22b-f1bf46a419a6 req-49cb9539-994e-4a61-ad3b-7e0e635151f4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.622065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-0fd94033-3de5-4f51-b22b-f1bf46a419a6 req-49cb9539-994e-4a61-ad3b-7e0e635151f4 service nova] Creating event network-changed:d840dfba-98a6-425f-b11b-365b0749db34 for instance 05854927-1ff5-4246-9509-c677fbb0a9f2 on hv-cinder-85054 Jul 20 19:28:37.628512 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-0fd94033-3de5-4f51-b22b-f1bf46a419a6 req-49cb9539-994e-4a61-ad3b-7e0e635151f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jul 20 19:28:37.629641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 54/98] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:37.728833 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-a56c2640-8d53-47b8-b845-089631de81ba req-4c2115ca-c205-4aa1-8cab-ec0554eec2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:37.738986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-a56c2640-8d53-47b8-b845-089631de81ba req-4c2115ca-c205-4aa1-8cab-ec0554eec2e7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.739432 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-a56c2640-8d53-47b8-b845-089631de81ba req-4c2115ca-c205-4aa1-8cab-ec0554eec2e7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.752038 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-a56c2640-8d53-47b8-b845-089631de81ba req-4c2115ca-c205-4aa1-8cab-ec0554eec2e7 service nova] Creating event network-changed:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:28:37.758354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-a56c2640-8d53-47b8-b845-089631de81ba req-4c2115ca-c205-4aa1-8cab-ec0554eec2e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033868 Jul 20 19:28:37.759484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 55/99] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:28:37.779339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:37.807240 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-53a3375a-df8c-4498-88f3-39569830f3c5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.707479 Jul 20 19:28:37.808186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 45/100] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:37.924524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.925248 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.931763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.932210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.933003 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.933449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.978168 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.978896 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.985887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.986597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.987526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.988125 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.123434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.133591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4b29ae48-01b4-423c-9864-2edade8d3280 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.212962 Jul 20 19:28:38.134628 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 56/101] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:38.175194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.183618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.185170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.186452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-157d8cee-dbd5-4080-b900-ca35306a1e2d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.212776 Jul 20 19:28:38.187022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 46/102] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:38.607614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:38.608232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:38.614602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.615097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.616044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.616490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.768337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.776591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a2bcf00f-a9e7-42c0-8df7-015ab06e0f21 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.172852 Jul 20 19:28:38.777200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 57/103] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:38 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:38.824335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:38.824992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:38.831151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.831604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.832381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.832821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.995019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.002465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d115474b-9b77-410f-ae61-e8d3e93aae10 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.182155 Jul 20 19:28:39.003041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 47/104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:38 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:39.156838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:39.160747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:39.165614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.166088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.166840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.167269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.205809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:39.206427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:39.214737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.214737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.215160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.215724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.367831 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.378219 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d705a305-3610-4f7a-bae5-ba30bb377edd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.231231 Jul 20 19:28:39.385443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 58/105] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:39 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:39.426068 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.445040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.446826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.448040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ccf5bbc4-c2f8-44f5-a731-2896813c8c0d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.245944 Jul 20 19:28:39.448620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 48/106] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:39 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:39.795249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:39.795976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:39.802143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.802666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.803622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.804257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.957631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.966245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9a63d3aa-2b35-495a-9cc1-f729fbc33b15 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.175205 Jul 20 19:28:39.966875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 59/107] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:39 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:40.020170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.021150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.028516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.028997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.029764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.030295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.194414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.204689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e5402149-880b-4cbe-89a7-1be93f2b13bf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.188637 Jul 20 19:28:40.205405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 49/108] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:40.398796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.399740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.406702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.406979 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.407968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.408400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.466551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.467794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.474089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.474862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.476453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.477320 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.612412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.621169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-78b1ff5f-b2e3-415b-ac08-c50ba78bf432 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.228710 Jul 20 19:28:40.622426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 60/109] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:40.668128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.686202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.687937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.689875 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2079a9d8-86e2-4562-ad2d-4917f1d4eb4b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.227486 Jul 20 19:28:40.690657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 50/110] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:40.985281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.985896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.993003 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.993435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.994209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.994639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.013950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:41.142129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.150526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ddaab2ab-e980-4a0a-bc1c-6c16a60bc38b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.169922 Jul 20 19:28:41.151189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 61/111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:41.223626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:41.224406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:41.231606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.232166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.233085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.233531 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.379489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.396262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-af5948cd-b218-4c56-bfef-8b6860a4e4c9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.176408 Jul 20 19:28:41.398167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 51/112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:41 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:41.643268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:41.643885 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:41.651286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.651723 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.653096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.653578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.710260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:41.710889 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:41.717291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.717749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.719035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.719487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.944609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.947862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a4aae2fb-13cf-4040-9ffe-082a7d21c34c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.308491 Jul 20 19:28:41.948581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 62/113] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:41 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:41.980386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.991155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.993179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.995974 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6db0151f-b2e7-464b-8949-76d6eab93022 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.290945 Jul 20 19:28:41.996825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 52/114] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:41 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:42.171957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:42.172601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:42.180651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.181003 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.181785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.182223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.323258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:42.331096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a587c73d-6d95-4abd-8bdb-94c8441fb293 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.166595 Jul 20 19:28:42.331661 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 63/115] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:42 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:42.415563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:42.416177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:42.422408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.422862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.423628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.424063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.573021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:42.580958 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-264927b0-d2cd-4d7e-b983-5d0721319aa2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.169753 Jul 20 19:28:42.581528 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 53/116] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:42 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:42.966311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:42.967431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:42.973633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.974153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.975079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.975584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.017504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:43.018758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:43.033287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.034145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.035151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.035877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.207094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.216590 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e1f9501c-1e79-4f41-bd39-690ca69b14a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.254206 Jul 20 19:28:43.217403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 64/117] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:42 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:43.228191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.239278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.241636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.242911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c0968971-2ab8-4eb8-8850-7e434486b3d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.231627 Jul 20 19:28:43.253232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 54/118] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:43 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:43.349005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:43.349830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:43.357662 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.358420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.359478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.360081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.525564 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.535905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2fa2b678-eae0-433f-92ee-001887f4ae49 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.191993 Jul 20 19:28:43.537710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 65/119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:43 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:43.600844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:43.601746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:43.609568 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.610341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.611545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.611901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.917108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.925679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0aba9c5d-d59d-4300-a83f-c1e03c24ca7a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.329710 Jul 20 19:28:43.926436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 55/120] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:43 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:44.233907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:44.234683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:44.243509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.244464 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.245284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.245709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.262929 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:44.263924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:44.271340 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.273199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.274788 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.275475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.575077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.575533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.586644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.588246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.589114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f807f893-ed50-419c-919e-588b4cf91b8a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.358904 Jul 20 19:28:44.589394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-50ef110e-f4ee-4323-be47-4076f7aaf622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.331685 Jul 20 19:28:44.590617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 66/121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:44 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:44.595488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:44.596320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:44.605873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 56/122] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:44 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:44.607477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.617865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.619018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.619614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.868786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.876256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c8fb9809-f6eb-45df-9eff-773e7bee2134 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.284495 Jul 20 19:28:44.876826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 67/123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:44 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:44.944461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:44.945257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:44.951864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.952441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.953358 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.953934 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.227181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:45.235557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4f850c20-4682-48a8-a5df-b111f1dfa92a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.295700 Jul 20 19:28:45.236145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 57/124] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:44 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:45.618688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:45.619480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:45.620154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:45.620693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:45.632090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.636601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.637371 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.639263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.639463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.640517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.642589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.642888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.075574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.076808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.101387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a3f09c29-5794-4005-9d16-0cc2b52a1548 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.495365 Jul 20 19:28:46.102619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.104825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.105626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 58/125] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:45 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:46.108213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3e0f52c1-5dfa-4570-9d74-7d888535d438 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.501728 Jul 20 19:28:46.110806 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 68/126] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:45 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:46.125994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:46.126645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:46.134255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.134709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.135491 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.135932 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.254336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:46.255102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:46.262135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.262837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.263810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.264459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.642521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.651344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.659408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-16fa59f5-33f6-4257-836e-c85298fe1b86 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.408889 Jul 20 19:28:46.660199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9aa4009d-b37e-440e-94e9-7385c4c12eff tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.553385 Jul 20 19:28:46.661842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 69/127] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:46 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:46.673696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 59/128] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:46 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:47.125318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.126039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.133813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.134696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.141327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.142467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.143368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.145686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.146153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.146378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.148784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.150115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.670395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:47.682173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:47.683999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:47.685464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1662bac6-99cd-47ea-9bae-f33bf0b2e2e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.557500 Jul 20 19:28:47.689259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 60/129] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:47.695437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.698957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.710118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.711143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.712536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.726500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.739407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:47.757649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bf7772d7-e9df-4574-9948-5f2e85b8409e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.638507 Jul 20 19:28:47.758242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 70/130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:47.763079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.763897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.786584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.787028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.788605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.789075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.138936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:48.147348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ac7588eb-fa92-40d1-86c2-4e3d55c8c70e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.456027 Jul 20 19:28:48.148578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 61/131] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:48.226370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:48.241605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b0c955c0-370e-4ab4-96c5-db6b6086d25c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.479769 Jul 20 19:28:48.242669 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 71/132] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:48.712273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:48.712908 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:48.719031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.719486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.720263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.720692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.724962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:48.776052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:48.776775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:48.783330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.785087 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.785854 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.786417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.096290 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.100859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.113685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-77f0b42b-32be-4779-9ce1-a931de98524e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.342316 Jul 20 19:28:49.114573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 72/133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:48 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:49.120356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.121961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.123417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-01e2803d-b992-4fa5-8695-68a9ad535353 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.415140 Jul 20 19:28:49.124141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 62/134] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:48 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:49.166608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:49.167543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:49.173990 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.174536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.175316 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.175755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.260823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:49.261510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:49.268052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.268498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.269292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.269723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.614075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.619532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.626360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9e757fab-30be-4956-9ca4-abef3335c1ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.464878 Jul 20 19:28:49.627430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 73/135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:49 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:49.637300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ec9fd504-1536-470a-ada9-fe4f7288ca4c tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.381464 Jul 20 19:28:49.638494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 63/136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:49 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:50.132594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:50.133945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:50.141079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.141844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.142849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:50.143470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:50.143601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.144426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.153618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.154072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.158151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.158603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.379390 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.387573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-643c60bc-dab1-452a-9188-e5267b7bc7ee tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.259865 Jul 20 19:28:50.388407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 74/137] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:50 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:50.394333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.403619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.405159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.406447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d70b3f8f-1ca0-42f5-8bbf-b66c8293583e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.268001 Jul 20 19:28:50.407450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 64/138] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:50 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:50.643811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:50.644746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:50.655532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.656128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:50.656576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.657415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:50.658088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.659653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.671853 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.672591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.673774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:50.674417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:50.947277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.954405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:50.963999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6244d5c0-4583-4ef2-b209-dc817643361b tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.312681 Jul 20 19:28:50.964597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 65/139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:50 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:50.973372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-04622d4b-c839-4ce7-b846-734485fb4ff6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.333339 Jul 20 19:28:50.974248 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 75/140] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:50 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:51.405377 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:51.406110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:51.413280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.413807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.415387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.416038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.424340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:51.425597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:51.442307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.442933 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.445749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.446251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.724755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:51.736196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-85349244-7198-436d-bfe8-5e7d787f72a3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.334780 Jul 20 19:28:51.736791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 66/141] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:51 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:51.755337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:51.770809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:51.773556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:51.774974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1b58dab0-0e39-40be-94a9-c9a96cb1b5b5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.354683 Jul 20 19:28:51.776063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 76/142] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:51 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:51.981639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:51.982345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:51.994155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:51.995282 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:52.004557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.007467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.010141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.011389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.012150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.012982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.014064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.018310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.351793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:52.369702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d3745b7e-9e8d-4228-aa3b-d7a4aa4233b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.381886 Jul 20 19:28:52.370539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 77/143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:51 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:52.398406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:52.407065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a46fcf7e-9356-44cf-b39f-92d943e5f79e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.429142 Jul 20 19:28:52.418854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 67/144] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:51 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:52.753931 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:52.755118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:52.762018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.762727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.763656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.764239 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.794052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:52.794669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:52.797974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:52.804709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.805183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:52.805969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:52.806488 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:53.207094 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:53.234224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:53.236164 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:53.237519 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-be1f5af5-5247-4d55-9b15-2f55afbac511 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.448285 Jul 20 19:28:53.238347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 68/145] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:52 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:53.260601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:53.286243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-883e4976-9920-4e36-829b-ca4074075194 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.533528 Jul 20 19:28:53.287019 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 78/146] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:52 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:53.387809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:53.388425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:53.395725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:53.396172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:53.404801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:53.405405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:53.426284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:53.426900 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:53.440802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=97 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:53.442415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:53.442864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:53.444170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:53.444605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.326159 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:54.345211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-42ebffca-9ba7-43d2-8dbd-6821ed85d85f tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.919995 Jul 20 19:28:54.348213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 79/147] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:53 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:54.377697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:54.378565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:54.410890 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.412178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.415506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.417589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.518937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:54.530411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8a4a176f-fdb3-4cc5-b476-937bae9be044 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 1.144130 Jul 20 19:28:54.531209 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 69/148] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:53 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:54.554694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:54.555838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:54.571030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.574160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.579390 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.581175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:54.748494 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:54.762422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:54.766021 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:54.770766 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-66ae8436-35ae-4d21-afe0-73e6fc44446a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.420874 Jul 20 19:28:54.782075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 80/149] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:54 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:54.966630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-92389f89-9871-4c43-944b-caf220cd7186 req-97e77f4c-0ca5-41b5-8b1c-185c4bdbb4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e030ad0-4549-4070-bf06-563e23b2dce5", "name": "network-vif-plugged", "status": "completed", "tag": "a2c254e5-f31b-4788-9fa7-0f9ebfad4218"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:54.987795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-92389f89-9871-4c43-944b-caf220cd7186 req-97e77f4c-0ca5-41b5-8b1c-185c4bdbb4ac service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:54.989431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-92389f89-9871-4c43-944b-caf220cd7186 req-97e77f4c-0ca5-41b5-8b1c-185c4bdbb4ac service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.013758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:55.027419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2f699dcb-03ed-4880-920d-6ff0c3e0ebae tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.491840 Jul 20 19:28:55.029778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 70/150] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:54 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:55.042644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-92389f89-9871-4c43-944b-caf220cd7186 req-97e77f4c-0ca5-41b5-8b1c-185c4bdbb4ac service nova] Creating event network-vif-plugged:a2c254e5-f31b-4788-9fa7-0f9ebfad4218 for instance 0e030ad0-4549-4070-bf06-563e23b2dce5 on hv-cinder-85054 Jul 20 19:28:55.050783 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-92389f89-9871-4c43-944b-caf220cd7186 req-97e77f4c-0ca5-41b5-8b1c-185c4bdbb4ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267390 Jul 20 19:28:55.057626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 81/151] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:55.366427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:55.367508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:55.374064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=91 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:55.376192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.376869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.377936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.378809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.565998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:55.567990 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:55.613976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.617840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.618897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.619528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.684939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:55.696191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8629a739-09e8-469e-93a3-8493ca36aadc tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.331870 Jul 20 19:28:55.696843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 71/152] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:55 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:55.802183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:55.804359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:55.824367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.827990 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:55.833387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:55.836200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.184325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:56.207268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:56.208895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:56.220195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ca43b004-d388-41c5-9910-4f56a6c07f1f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.420035 Jul 20 19:28:56.221438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 72/153] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:55 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:56.229547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:56.233618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:56.251929 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.252916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.255092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.256048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.329139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:56.342198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b140ac29-7fc6-4036-a504-93ab3fd6cad1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.783601 Jul 20 19:28:56.344806 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 82/154] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:55 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:56.688068 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:56.697542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-af76b04c-ad7b-4f53-881c-3c055113a55d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.474800 Jul 20 19:28:56.698149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 73/155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:56 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:56.718720 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:56.719908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:56.733369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.735068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.739205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.740696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.033587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:57.043685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-03574043-6ede-4dc9-b45a-49d69b53e139 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.328624 Jul 20 19:28:57.056608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 83/156] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:56 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:57.185238 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-444b9fdf-af2b-4f10-a23a-87c1a1a3609f req-d0f344e0-881a-4fc2-bf10-d8b161289393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a52396-c000-4931-8896-46dcf99d449a", "name": "network-vif-plugged", "status": "completed", "tag": "a6b0ac08-0caa-47dc-9d21-4afca1983d3b"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:57.210884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-444b9fdf-af2b-4f10-a23a-87c1a1a3609f req-d0f344e0-881a-4fc2-bf10-d8b161289393 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.212043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-444b9fdf-af2b-4f10-a23a-87c1a1a3609f req-d0f344e0-881a-4fc2-bf10-d8b161289393 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.230119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-444b9fdf-af2b-4f10-a23a-87c1a1a3609f req-d0f344e0-881a-4fc2-bf10-d8b161289393 service nova] Creating event network-vif-plugged:a6b0ac08-0caa-47dc-9d21-4afca1983d3b for instance a0a52396-c000-4931-8896-46dcf99d449a on hv-cinder-85054 Jul 20 19:28:57.236506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-444b9fdf-af2b-4f10-a23a-87c1a1a3609f req-d0f344e0-881a-4fc2-bf10-d8b161289393 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054694 Jul 20 19:28:57.241489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 74/157] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:57.251756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:57.252557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:57.260082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.260544 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.261358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.262048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.374408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:57.378534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:57.408192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.408915 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.416541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.417995 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.691713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:57.706537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:57.751818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:57.759226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e6ac066a-e5a8-4c8d-b5c8-2d5e5dbf1838 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.511179 Jul 20 19:28:57.770782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 84/158] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:57 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:57.801247 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:57.819649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:57.843458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.844178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.845537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.846273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.091022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:58.104391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2bf2b6ba-4197-4f4b-9a23-615be92b4747 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.730521 Jul 20 19:28:58.105187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 75/159] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:57 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:58.124506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:58.126374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:58.135510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.137763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.139047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.139636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.214550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:58.223860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-76891149-cd4a-4c57-b7e9-315085599769 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.450599 Jul 20 19:28:58.225577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 85/160] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:57 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:58.326421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:58.339412 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a32e0553-b85d-4b0e-b67b-0c712381b10a tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.224694 Jul 20 19:28:58.343723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 76/161] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:58 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:58.777971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:58.779202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:58.787868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.788428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.790685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.791232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.094667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.108174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.109932 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.112019 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-806b24de-eb29-43cb-8687-70dd08bcf1ee tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.337849 Jul 20 19:28:59.113411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 86/162] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:58 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:59.130539 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:59.131343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:59.140624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.141348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.142518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.143132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.243747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:59.244802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:59.265511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.268925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.269999 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.271150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.544865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.561447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-27ab264d-e7af-4778-b314-fe122f85ffd6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.442675 Jul 20 19:28:59.565301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.575884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-97fd116a-5c19-46a5-96ac-9808e62a93bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.337416 Jul 20 19:28:59.576061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 77/163] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:59 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:59.577249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 87/164] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:59 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:59.590285 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-0c626b07-5c9e-447d-8216-0733066987c5 req-6c8972da-f7bb-4570-8326-6ce2033b67c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199315e6-e6f0-4c28-b63f-40ec5e5bef49", "name": "network-vif-plugged", "status": "completed", "tag": "7da85c79-f873-46d3-99dc-20d26d7d7408"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:59.613391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-0c626b07-5c9e-447d-8216-0733066987c5 req-6c8972da-f7bb-4570-8326-6ce2033b67c7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.613896 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-0c626b07-5c9e-447d-8216-0733066987c5 req-6c8972da-f7bb-4570-8326-6ce2033b67c7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.639058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-0c626b07-5c9e-447d-8216-0733066987c5 req-6c8972da-f7bb-4570-8326-6ce2033b67c7 service nova] Creating event network-vif-plugged:7da85c79-f873-46d3-99dc-20d26d7d7408 for instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 on hv-cinder-85054 Jul 20 19:28:59.651270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-0c626b07-5c9e-447d-8216-0733066987c5 req-6c8972da-f7bb-4570-8326-6ce2033b67c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073172 Jul 20 19:28:59.652558 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 78/165] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:59.658855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:59.661541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:59.668972 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.670119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.671152 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.671752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.854268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.873688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4c11c51b-13ce-4e01-a593-e9e1ece23167 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.213990 Jul 20 19:28:59.874625 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 79/166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:59 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:00.074450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-77b0878d-3159-4cdd-906e-2b5657aa2faf tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Action: 'create', calling method: .version_select at 0x7f0e8682ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2006792000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEy8N+VKvqGIZIBT+lShN6276Kn7wDvfq2H02bQ6gutLonn/leC2Kb0a1YK1pJLhC8ylu8ZmwF14rEe0YMc1U7SO34NF/FGo5uakc2GljJCS7ryhSGL97RN5ru++JJITg=="}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:00.106843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-77b0878d-3159-4cdd-906e-2b5657aa2faf tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for project 3f1255754afb4cd384a11c87a9d717df. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:00.123389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-77b0878d-3159-4cdd-906e-2b5657aa2faf tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for user 493d126879f44b26951920235e7f7730 and project 3f1255754afb4cd384a11c87a9d717df. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:00.132348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.133135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.147518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.150104 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.154261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.154731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.165406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:00.189789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-77b0878d-3159-4cdd-906e-2b5657aa2faf tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.611239 Jul 20 19:29:00.196399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 88/167] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:28:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:00.401102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:00.420035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:00.422136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:00.424874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-465975a5-45fa-497b-b3b4-36f6d2d5e65e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.296926 Jul 20 19:29:00.441599 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 80/168] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:00.583798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.585105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.594159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.595041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.600338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.604545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.606129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.609618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.610481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.626660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.628206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.631620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.956463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:00.970435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-77262a71-0412-4268-ace2-3249312b2dfd tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.391600 Jul 20 19:29:00.971104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 89/169] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:00.993919 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.994564 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:01.026170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.029256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.032848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.033533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.309086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.330498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-76c4707b-cf37-4a24-8937-f9ae5154c3dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1321 microversion: 2.1 time: 0.740314 Jul 20 19:29:01.339426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 81/170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:01.449778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:01.450411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:01.472827 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.476538 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.479771 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.480540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.520173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.530835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c67ddbd0-f053-4b14-a0d6-f41ea8aa5483 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.558446 Jul 20 19:29:01.535302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 90/171] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:01.707325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.716733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.719392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.721222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4735a626-3966-422e-8462-27aa9ecac492 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.278102 Jul 20 19:29:01.727764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 82/172] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:01 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:01.737376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-3be6949f-41b6-4d53-b001-7b737dcb4d59 req-5ddb6698-6db6-4ed4-bfe5-390db3e1dd9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05854927-1ff5-4246-9509-c677fbb0a9f2", "name": "network-vif-plugged", "status": "completed", "tag": "d840dfba-98a6-425f-b11b-365b0749db34"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:01.748178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-3be6949f-41b6-4d53-b001-7b737dcb4d59 req-5ddb6698-6db6-4ed4-bfe5-390db3e1dd9d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.748980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-3be6949f-41b6-4d53-b001-7b737dcb4d59 req-5ddb6698-6db6-4ed4-bfe5-390db3e1dd9d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.764628 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-3be6949f-41b6-4d53-b001-7b737dcb4d59 req-5ddb6698-6db6-4ed4-bfe5-390db3e1dd9d service nova] Creating event network-vif-plugged:d840dfba-98a6-425f-b11b-365b0749db34 for instance 05854927-1ff5-4246-9509-c677fbb0a9f2 on hv-cinder-85054 Jul 20 19:29:01.771775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-3be6949f-41b6-4d53-b001-7b737dcb4d59 req-5ddb6698-6db6-4ed4-bfe5-390db3e1dd9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Jul 20 19:29:01.773064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 91/173] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:01.988983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:01.989734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.001956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.002949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.003831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.004587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.351423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.352669 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.377066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.377928 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.378891 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.380014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.698831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.716348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f51f9959-9e76-4684-8a40-35174fa7e611 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.732320 Jul 20 19:29:02.717410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 83/174] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:01 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:02.722390 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.729017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.744145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.744598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.751039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.751732 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.935598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.955336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-02ecfb40-2589-4d14-9234-bed59ad5baf5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1514 microversion: 2.1 time: 0.607150 Jul 20 19:29:02.960035 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 92/175] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1514 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:02.978670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.979233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.010505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.011951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.014960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.016577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.045816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.060125 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6923a357-815d-4a6e-9dfe-f4807b0d57b1 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.341228 Jul 20 19:29:03.062623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 84/176] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:03.072259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:03.074726 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.097536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.098399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.127303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.128534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.217296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.232947 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.234488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.240956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-89786793-741f-47ad-a8c5-bc3d999c588c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.273969 Jul 20 19:29:03.249071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 93/177] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:03.273799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lazy-loading 'flavor' on Instance uuid a0a52396-c000-4931-8896-46dcf99d449a {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:03.454311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1de61300-70cd-4dd0-84a3-3a7a41cbd2e4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a/action" status: 200 len: 32 microversion: 2.1 time: 0.389849 Jul 20 19:29:03.455001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 85/178] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:29:03 2022] POST /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:29:03.472546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:03.474364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.485543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.486411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.487477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.499948 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.737108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:03.757077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.783300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.789697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.794061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.794774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.384204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.398141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cb80ce47-c34e-4100-942a-70b9dc0d6a64 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.937008 Jul 20 19:29:04.398727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 94/179] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:03 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:04.404914 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-b3d94073-a3e2-41bb-95e4-866f429ac480 req-5ea4e8cb-41f4-4ef8-9654-7481e4c41724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "name": "network-vif-plugged", "status": "completed", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:04.415849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b3d94073-a3e2-41bb-95e4-866f429ac480 req-5ea4e8cb-41f4-4ef8-9654-7481e4c41724 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.416618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b3d94073-a3e2-41bb-95e4-866f429ac480 req-5ea4e8cb-41f4-4ef8-9654-7481e4c41724 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.435702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-b3d94073-a3e2-41bb-95e4-866f429ac480 req-5ea4e8cb-41f4-4ef8-9654-7481e4c41724 service nova] Creating event network-vif-plugged:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:29:04.450347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-b3d94073-a3e2-41bb-95e4-866f429ac480 req-5ea4e8cb-41f4-4ef8-9654-7481e4c41724 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049721 Jul 20 19:29:04.452719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 95/180] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:04.461066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.469507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:04.470831 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:04.472200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5a34d15a-2ace-4601-bcf8-150e1b8b3a2b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.741915 Jul 20 19:29:04.472835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 86/181] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:03 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:04.482586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:04.482586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:04.486321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.486830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.487953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.488648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.491410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.492078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.493103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.494553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.829924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.841561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.848239 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-849e47b8-efb4-4ba4-9a65-7e6399f27044 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1315 microversion: 2.1 time: 0.392569 Jul 20 19:29:04.849061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 96/182] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:04 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:04.856290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.857808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.859093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-84b37f3b-d0e5-48fd-a3ff-44e69d6f3168 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.385197 Jul 20 19:29:04.859817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 87/183] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:04 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:05.416310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.417896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.440986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.441603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.442459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.442905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.490087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.490865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.497468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.498039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.498943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.499585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.700579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:05.704792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:05.711787 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3d66a34a-3e38-4b4d-add0-45af6459c7d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.300756 Jul 20 19:29:05.721966 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 97/184] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:05.758808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:05.775229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-edbe72de-d866-4269-9ca8-63fd5ffbe0ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1364 microversion: 2.1 time: 0.289392 Jul 20 19:29:05.776426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 88/185] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:05.867129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.868024 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.874832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.875264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.876063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.876472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.878346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.879206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.885401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.885854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.888241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.888720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.085154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.091675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.092912 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f91d4121-4903-48f6-a525-b6c9d7ed3bd0 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1502 microversion: 2.1 time: 0.231715 Jul 20 19:29:06.097757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 98/186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:06.100214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.102083 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.103275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-15d887f4-75b3-492e-89a6-da41a1af4c96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.228888 Jul 20 19:29:06.113487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 89/187] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:06.729103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:06.730420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:06.739006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.739456 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.740437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.743310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.792673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:06.793329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:06.799927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.800411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.801404 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:06.802214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.957275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.972292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ec43cc8c-1a2a-4bf9-a051-496141e32149 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.246571 Jul 20 19:29:06.973530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 99/188] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:06 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:06.985528 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.998768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-63343f48-2a7a-40bb-ad61-5691a007c59e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1550 microversion: 2.1 time: 0.209648 Jul 20 19:29:07.008163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 90/189] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:06 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1550 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:07.017489 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:07.018037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.024615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.025093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.025906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.026501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.120965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:07.121638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.127815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.128464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.130085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.130780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.182851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-591ddc71-c624-4f03-a538-9c667814fb3b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169416 Jul 20 19:29:07.183934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 100/190] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:29:07 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:07.339099 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.350308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.352407 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.353563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-396744ae-e2ce-4c8a-9169-6c3d09320101 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.236942 Jul 20 19:29:07.354131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 91/191] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:07 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:07.576219 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36251e09-9110-4f2e-9d31-b505603193b6"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:07.577264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.594004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.595499 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.596680 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.597512 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.990420 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:07.991869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.998879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.999695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.000846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.001540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.179344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e29c6b4b-d18d-4cb0-ad27-785804516659 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "POST /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605840 Jul 20 19:29:08.181004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 101/192] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:29:07 2022] POST /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:08.256747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.268035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-91c0c3b7-f5a8-4b79-b601-9c8239e0212b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.281852 Jul 20 19:29:08.269685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 92/193] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:07 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:08.372730 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:08.373736 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:08.381108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.381871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.382986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.383897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.562323 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.572223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.573922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.575075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bf9b8aa1-bbff-4b2a-a3c6-50531bb496eb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.206570 Jul 20 19:29:08.575639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 102/194] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:08 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:09.013207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-29ffe49e-d634-467f-acbe-ccef0eecabcd req-10204414-6269-4521-900b-8066f7a9833f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05854927-1ff5-4246-9509-c677fbb0a9f2", "tag": "d840dfba-98a6-425f-b11b-365b0749db34"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:09.026566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-29ffe49e-d634-467f-acbe-ccef0eecabcd req-10204414-6269-4521-900b-8066f7a9833f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.027013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-29ffe49e-d634-467f-acbe-ccef0eecabcd req-10204414-6269-4521-900b-8066f7a9833f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.052233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-29ffe49e-d634-467f-acbe-ccef0eecabcd req-10204414-6269-4521-900b-8066f7a9833f service nova] Creating event network-changed:d840dfba-98a6-425f-b11b-365b0749db34 for instance 05854927-1ff5-4246-9509-c677fbb0a9f2 on hv-cinder-85054 Jul 20 19:29:09.065119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-29ffe49e-d634-467f-acbe-ccef0eecabcd req-10204414-6269-4521-900b-8066f7a9833f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055346 Jul 20 19:29:09.065753 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 93/195] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:09.291190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:09.293278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:09.305026 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.305523 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.306336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.311320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.506883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.514855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4a7fd5be-99bb-46c4-900e-745b6bde77a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.233385 Jul 20 19:29:09.516956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 103/196] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:09 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:09.595425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:09.596175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:09.610382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.612098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.614013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.614942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.780809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.791578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.793467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.794806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0805f5a6-f1ff-4db6-8b1d-fef911c04907 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1406 microversion: 2.20 time: 0.204440 Jul 20 19:29:09.795935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 94/197] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:09 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:10.539245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.542389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.548171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=4 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:10.561202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.561797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.563015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.563576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.771989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.781641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f41930ce-9916-48d4-b736-2f18250c75a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.251505 Jul 20 19:29:10.782171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 104/198] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:10.814880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.815522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.822526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.822962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.823939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.824444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.852129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:10.989024 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.999799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.001548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.002939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-eee50df3-76f6-45a4-ad7d-0037edd4b746 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1598 microversion: 2.20 time: 0.192087 Jul 20 19:29:11.003672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 95/199] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:11.031567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:11.032066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:11.038496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.038952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.039721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.040298 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.125500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a87986d2-65f5-4f4a-9b11-03801d0062ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098064 Jul 20 19:29:11.126555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 105/200] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 19:29:11 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:29:11.801207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:11.802176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:11.811395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.811913 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.812977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.813485 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.975776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.985867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9a6b0b7d-d6ee-4ad8-93dc-1ac13e2aa999 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.188403 Jul 20 19:29:11.987782 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 96/201] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:11 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:12.653864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-732554e7-ebbf-4f01-a9b3-cd17286ab142 req-2db47c63-951e-4892-88c6-f20c9babad0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:12.665352 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-732554e7-ebbf-4f01-a9b3-cd17286ab142 req-2db47c63-951e-4892-88c6-f20c9babad0b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.666109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-732554e7-ebbf-4f01-a9b3-cd17286ab142 req-2db47c63-951e-4892-88c6-f20c9babad0b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.682343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-732554e7-ebbf-4f01-a9b3-cd17286ab142 req-2db47c63-951e-4892-88c6-f20c9babad0b service nova] Creating event network-changed:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:29:12.697313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-732554e7-ebbf-4f01-a9b3-cd17286ab142 req-2db47c63-951e-4892-88c6-f20c9babad0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047364 Jul 20 19:29:12.699094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 106/202] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:13.005047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:13.006846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:13.013475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.014207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.015188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.015813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.243772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.256550 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-19d637e5-7364-4d4d-9553-d34a4d9abbd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.256165 Jul 20 19:29:13.257498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 97/203] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:12 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:14.277307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.278007 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.284451 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.284922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.285695 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.286157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.436331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.444163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-805a523a-7c97-460c-8f57-168b25b1e941 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.171711 Jul 20 19:29:14.444856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 107/204] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:15.464039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.464732 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.471500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.471960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.472779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.475801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.656760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.666416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e5f22b0d-e33e-4bfe-82c7-6713a44e4491 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.207814 Jul 20 19:29:15.667108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 98/205] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:16.684441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.685579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.691923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.692347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.693198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.693726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.833854 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.841350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-55319c22-eb14-45e2-aa95-f72e7962ae12 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.160671 Jul 20 19:29:16.845005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 108/206] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:17.858805 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:17.860155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:17.867314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.867775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.868679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.869005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.029499 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.039809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b9dd80cd-57e1-4919-95c3-6b9b32b4a245 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.184721 Jul 20 19:29:18.040518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 99/207] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:17 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:19.057465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:19.058079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:19.064760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.065239 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.066000 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.066460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.203837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.212656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-74c9a0ca-5de3-4f6e-94b3-1c904fc084ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.159274 Jul 20 19:29:19.213272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 109/208] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:19 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:20.230062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:20.230665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:20.237170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.237549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.238311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.238742 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.386438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.393982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6704446f-9e94-4667-a508-a90d681728df tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.167883 Jul 20 19:29:20.394651 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 100/209] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:20 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:21.415651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:21.416273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:21.423770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.424221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.425102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.425667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.589728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.598202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-957b2a8b-81ad-4251-bdae-480174f720f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.189256 Jul 20 19:29:21.598785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 110/210] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:21 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:22.336763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.337446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.343496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.343981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.344728 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.345198 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.371082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:29:22.471578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d76f4fc0-cd68-47fa-b38c-9e4a7c4bebfe tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "DELETE /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 204 len: 0 microversion: 2.1 time: 0.139054 Jul 20 19:29:22.472588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 101/211] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:29:22 2022] DELETE /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:29:22.481710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.482691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.488972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.489474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.490403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.491060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.619386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.620822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.629950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.630524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.631793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.632446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.648651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.659099 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6379bf2c-7b39-447c-9ddb-9626346db0b9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1554 microversion: 2.1 time: 0.181841 Jul 20 19:29:22.660245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 111/212] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:22.784534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:22.793005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-69e0b742-9bfd-41cb-b527-dc6ba66c54fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.180724 Jul 20 19:29:22.793590 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 102/213] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:23.677960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.678641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:23.681110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:23.686124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.686571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.687349 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.687792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.809455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.810062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:23.818798 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.819129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.820082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:23.820844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.847645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.857207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a2d08c45-ce85-4960-87f6-07f2d3d7e9a3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1554 microversion: 2.1 time: 0.183821 Jul 20 19:29:23.857783 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 112/214] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:23.983498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.993021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2c0fd733-b652-4c15-962f-a4258187444e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.187334 Jul 20 19:29:23.993705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 103/215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:24.875811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.876524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:24.884957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.885506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.886294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.886737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.012222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.012920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:25.020555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.022207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.022781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.023267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.061482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.072837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9834a745-77fb-4339-aff3-78c5f9f00d4e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1554 microversion: 2.1 time: 0.202000 Jul 20 19:29:25.073927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 113/216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:25.216078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.225639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e0f3efb9-5778-4325-a50e-b83ad38c7251 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.217637 Jul 20 19:29:25.228138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 104/217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:26.098507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.099123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.106706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.107182 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.107946 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.108383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.127029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:26.247108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.248389 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.252557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:26.257447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.258813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.260097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.261045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.289958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.302746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-77e13b67-3800-4dfb-a256-949f4bc8e407 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1554 microversion: 2.1 time: 0.207654 Jul 20 19:29:26.304608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 114/218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:26.480438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.497408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9e8d7be7-3f8f-4954-a435-8324dcdb108a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.253741 Jul 20 19:29:26.499667 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 105/219] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:27.321028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.321642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.328219 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.328659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.329615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.330044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.522569 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.523283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.531710 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.532508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.533780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.535133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.797678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.807358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-52ea127e-dde2-4116-ad68-4ea9da7b411e tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1554 microversion: 2.1 time: 0.490439 Jul 20 19:29:27.808303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 115/220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1554 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:27.889025 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.898580 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3dd03f3b-2945-4108-9d1d-ec1e4c6f3022 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.382104 Jul 20 19:29:27.899353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 106/221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:28.818942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-2361eb20-ac62-4bc8-9d4d-d5173b0f68d4 req-4b4fa5ab-de67-4557-8a06-2917736527f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "199315e6-e6f0-4c28-b63f-40ec5e5bef49", "name": "network-vif-deleted", "tag": "7da85c79-f873-46d3-99dc-20d26d7d7408"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:28.826608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.830158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.832703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-2361eb20-ac62-4bc8-9d4d-d5173b0f68d4 req-4b4fa5ab-de67-4557-8a06-2917736527f8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.838250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-2361eb20-ac62-4bc8-9d4d-d5173b0f68d4 req-4b4fa5ab-de67-4557-8a06-2917736527f8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.839142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.839899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.842012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.842663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.873643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-2361eb20-ac62-4bc8-9d4d-d5173b0f68d4 req-4b4fa5ab-de67-4557-8a06-2917736527f8 service nova] Creating event network-vif-deleted:7da85c79-f873-46d3-99dc-20d26d7d7408 for instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 on hv-cinder-85054 Jul 20 19:29:28.887798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-2361eb20-ac62-4bc8-9d4d-d5173b0f68d4 req-4b4fa5ab-de67-4557-8a06-2917736527f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073006 Jul 20 19:29:28.893752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 116/222] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:28.921202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.922898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.932598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.933135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.934051 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.934684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.057439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.068744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f7eab446-01df-4482-8930-ad434f3e1836 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1512 microversion: 2.1 time: 0.246263 Jul 20 19:29:29.069386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 107/223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:29.075114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1992919566", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "networks": [{"uuid": "6e06d9a4-c3cc-4d57-9431-dcfeac509b05"}]}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:29.146575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.154751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-66abc8f6-e002-440e-a9d1-8d778dd95d4b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.240654 Jul 20 19:29:29.155264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 117/224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:30.087932 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.088556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.095852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.096728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.097514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.097954 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.135562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.136012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.136483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lazy-loading 'fault' on Instance uuid 199315e6-e6f0-4c28-b63f-40ec5e5bef49 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:30.194259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a271ea90c6884817991aaa9e8be36cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183d6a3ee79e4fedb83591ce60694283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.205537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-006b06cd-17e7-447a-bf50-2d2398a5c676 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 200 len: 1351 microversion: 2.1 time: 0.122928 Jul 20 19:29:30.206344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 118/225] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:30.212430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.213493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.221996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.223085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.224554 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.225221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.392715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.402040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-54e8c3dc-5e3d-456d-8b89-1877dcdc7628 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.194364 Jul 20 19:29:30.402620 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 119/226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:31.226642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.227352 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.233863 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.234293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.235076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.235844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.249896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] HTTP exception thrown: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Request method failure captured: Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 HTTP/1.1 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc-7gRnzF5EKzPKq92U1_gP2-SfHpzioW4-i5Uc-xhW_9xTDvgt-kilDpX5SWGtU067aqLcHbzoQ7rOsd7pVk6rH6LQO7xpop2P6r2vsIi19CfTL3NeKbxbiLCh7RqwoucppjI97YvoPpkJLoQfjEPpS8STE0Dc1UJpFKQKzy1gt7k Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:29:31.255524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_183d6a3ee79e4fedb83591ce60694283", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: a271ea90c6884817991aaa9e8be36cab Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.257160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '199315e6-e6f0-4c28-b63f-40ec5e5bef49'} Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:31.258074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.259515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.260745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Returning 404 to user: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:31.260745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-dc2846b1-4616-42f6-ab76-ca9d9707abf9 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 404 len: 111 microversion: 2.1 time: 0.035199 Jul 20 19:29:31.260745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 120/227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:29:31.370568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.371605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.377976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.378423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.379206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.379638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.394328 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] HTTP exception thrown: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Request method failure captured: Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49/os-volume_attachments HTTP/1.1 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc-7gRnzF5EKzPKq92U1_gP2-SfHpzioW4-i5Uc-xhW_9xTDvgt-kilDpX5SWGtU067aqLcHbzoQ7rOsd7pVk6rH6LQO7xpop2P6r2vsIi19CfTL3NeKbxbiLCh7RqwoucppjI97YvoPpkJLoQfjEPpS8STE0Dc1UJpFKQKzy1gt7k Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:29:31.396017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_183d6a3ee79e4fedb83591ce60694283", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: a271ea90c6884817991aaa9e8be36cab Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.397606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'server_id': '199315e6-e6f0-4c28-b63f-40ec5e5bef49'} Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:31.398497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:31.399981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:31.401151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Returning 404 to user: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:31.401151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5fca0203-99e0-40c6-aaec-efcaf11a85e6 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031059 Jul 20 19:29:31.401151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 121/228] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:29:31.420254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.420862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.428300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.428865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.429668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.430104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.579297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.588455 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-29032fe4-2073-44a5-a681-92d891cbd096 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.172740 Jul 20 19:29:31.589125 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 122/229] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:32.606657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.607293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.613788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.614228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.615365 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.616080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.754444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.762991 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8272baab-456e-46a0-82d6-8f9a8703a14e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.160588 Jul 20 19:29:32.763671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 123/230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:32.768288 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.768719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.775756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.776254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.777163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.777594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.791886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] HTTP exception thrown: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Request method failure captured: Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: DELETE /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 HTTP/1.1 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc-7gRnzF5EKzPKq92U1_gP2-SfHpzioW4-i5Uc-xhW_9xTDvgt-kilDpX5SWGtU067aqLcHbzoQ7rOsd7pVk6rH6LQO7xpop2P6r2vsIi19CfTL3NeKbxbiLCh7RqwoucppjI97YvoPpkJLoQfjEPpS8STE0Dc1UJpFKQKzy1gt7k Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:29:32.793437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_183d6a3ee79e4fedb83591ce60694283", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: a271ea90c6884817991aaa9e8be36cab Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.794843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '199315e6-e6f0-4c28-b63f-40ec5e5bef49'} Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:32.795649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.796953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.798253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Returning 404 to user: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:32.798253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-53b06406-b6c4-46c9-8872-06e0cda711f3 tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "DELETE /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 404 len: 111 microversion: 2.1 time: 0.030231 Jul 20 19:29:32.798253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 124/231] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:29:32 2022] DELETE /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:32.804564 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.805189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] [instance: 199315e6-e6f0-4c28-b63f-40ec5e5bef49] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.811445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.811930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.812808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.813243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.828478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] HTTP exception thrown: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Request method failure captured: Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 HTTP/1.1 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc-7gRnzF5EKzPKq92U1_gP2-SfHpzioW4-i5Uc-xhW_9xTDvgt-kilDpX5SWGtU067aqLcHbzoQ7rOsd7pVk6rH6LQO7xpop2P6r2vsIi19CfTL3NeKbxbiLCh7RqwoucppjI97YvoPpkJLoQfjEPpS8STE0Dc1UJpFKQKzy1gt7k Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:29:32.830014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_183d6a3ee79e4fedb83591ce60694283", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/183d6a3ee79e4fedb83591ce60694283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 183d6a3ee79e4fedb83591ce60694283 Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-DeleteServersTestJSON-1266628881 Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: a271ea90c6884817991aaa9e8be36cab Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-DeleteServersTestJSON-1266628881-project Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.831378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '199315e6-e6f0-4c28-b63f-40ec5e5bef49'} Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:32.832250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. Jul 20 19:29:32.834047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:32.835173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] Returning 404 to user: Instance 199315e6-e6f0-4c28-b63f-40ec5e5bef49 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:32.835173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-13ab2403-8ea8-4cf9-a391-d97e1ac70c7d tempest-DeleteServersTestJSON-1266628881 tempest-DeleteServersTestJSON-1266628881-project] 10.222.0.79 "GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49" status: 404 len: 111 microversion: 2.1 time: 0.031190 Jul 20 19:29:32.835173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 125/232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/199315e6-e6f0-4c28-b63f-40ec5e5bef49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:29:33.785408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.788062 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.804358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.804925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.806048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.806768 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:34.031553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:34.044586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-21b67a3f-09ce-4847-83c0-fd5e2a3353d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.267304 Jul 20 19:29:34.045760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 126/233] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:35.065334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:35.065950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:35.080198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.080844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.081940 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.082492 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.416519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.425006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-58c5d713-a401-4a28-a2c0-a4cdc1b49cb0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.364386 Jul 20 19:29:35.426078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 127/234] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:35 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:36.444866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:36.445850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.453835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.453835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.454241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.454625 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.636317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.648137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6f1ab774-29a9-4959-8474-a7ad64b06f99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.207550 Jul 20 19:29:36.648821 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 128/235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:36 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:37.415495 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] validate_networks() for [('6e06d9a4-c3cc-4d57-9431-dcfeac509b05', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:29:37.669915 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.671203 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.678408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.679484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.680521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.681452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.886471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:29:37.886899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:29:37.887378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:29:37.887792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:29:37.888206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:29:37.898240 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.898694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.899501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.899940 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.908584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.916982 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1f23cede-1a4e-43a2-9d25-f159413f2bc9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.251055 Jul 20 19:29:37.917563 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 129/236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:37.919087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Getting quotas for project 2aa8c8dd804b46ca8996788a32b8383e. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:37.923273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Getting quotas for user e73da7d7237d4c9cb11c60a84e4dccd8 and project 2aa8c8dd804b46ca8996788a32b8383e. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:37.935560 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:29:37.937858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:29:37.991615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2ceeee6a-f6c2-4945-8d04-1b6badbb6022 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.921125 Jul 20 19:29:37.992482 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 108/237] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 8923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:29:38.002938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3f60f01c-841b-46ac-aff8-d363d1651108 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.003583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3f60f01c-841b-46ac-aff8-d363d1651108 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.065189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c7418939-7324-4a53-a46c-480581505aec tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Action: 'create', calling method: .version_select at 0x7f0e85f4cc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1758183330"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:38.084555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3f60f01c-841b-46ac-aff8-d363d1651108 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:38.092449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3f60f01c-841b-46ac-aff8-d363d1651108 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1219 microversion: 2.1 time: 0.093537 Jul 20 19:29:38.093073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 109/238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:38.418845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c7418939-7324-4a53-a46c-480581505aec tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.491708 Jul 20 19:29:38.419783 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 130/239] 10.222.0.79 () {60 vars in 1154 bytes} [Wed Jul 20 19:29:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 502 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:29:38.431299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8d92ac29-aa08-4c20-9f95-b7b8eb9c081b tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e860380d0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.502857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8d92ac29-aa08-4c20-9f95-b7b8eb9c081b tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 200 len: 345 microversion: 2.1 time: 0.075691 Jul 20 19:29:38.503732 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 110/240] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:38.934346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.934884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.941634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.942079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.943437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.943916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.082477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.090705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9c4c49f8-fa44-4d5f-bf12-287765a3c95d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.160702 Jul 20 19:29:39.091280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 131/241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:39.110021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.110632 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.118547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.119061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.119834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.120262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.189563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.197855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3fb1e6d8-0005-41c6-85e4-900f3aaff940 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1271 microversion: 2.1 time: 0.091735 Jul 20 19:29:39.198446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 111/242] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:39.519264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3211176f-f733-4425-9517-731005041ac7 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85d9eaf0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.589781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3211176f-f733-4425-9517-731005041ac7 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 200 len: 346 microversion: 2.1 time: 0.077531 Jul 20 19:29:39.591466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 132/243] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:39.611499 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-62086758-65ed-4d14-8236-6a1948dac3c5 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Action: 'create', calling method: .version_select at 0x7f0e87135c10>, body: {"snapshot": {"volume_id": "6c85dcc9-25ca-4170-9f50-c1a424a18ef2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-801602631"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:39.829363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-62086758-65ed-4d14-8236-6a1948dac3c5 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.228863 Jul 20 19:29:39.836013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 112/244] 10.222.0.79 () {60 vars in 1161 bytes} [Wed Jul 20 19:29:39 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:39.842847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d9b6e414-8969-41c9-aa7c-b54fce737906 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85ebedc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.881888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d9b6e414-8969-41c9-aa7c-b54fce737906 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.043597 Jul 20 19:29:39.882277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 133/245] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:39.891820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b46c143a-dbeb-45f2-896c-e7affd53c491 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85f08040>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.927897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b46c143a-dbeb-45f2-896c-e7affd53c491 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039544 Jul 20 19:29:39.928780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 113/246] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:39.942228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9a883d16-51e9-49ff-896c-5223c4b51afe tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85e5fe50>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.978500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9a883d16-51e9-49ff-896c-5223c4b51afe tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.042018 Jul 20 19:29:39.979098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 134/247] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:40.108461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.109123 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.116996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.117460 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.118902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.119456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.216241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.217059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.229910 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.230524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.231433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.232613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.571891 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.580677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0484a201-0bc2-48c7-ad64-4e12da4bdc43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.476778 Jul 20 19:29:40.581291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 114/248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:40.585951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.594584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-61d8af86-9fa6-4472-b0f2-b46a74b31414 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.382758 Jul 20 19:29:40.595449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 135/249] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:40.992350 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-30a6f928-8019-4aac-baa3-ed9d8fdea38a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85ffbc10>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.021680 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-30a6f928-8019-4aac-baa3-ed9d8fdea38a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.033916 Jul 20 19:29:41.022287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 115/250] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:41.597607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.598220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.605320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.605771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.606543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.606983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.614478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.615783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.622456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.623139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.624097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.624936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.629517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:41.822081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.830121 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7b21362a-a1ba-4a32-8bf9-b29c7453a1f4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.236306 Jul 20 19:29:41.830719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 136/251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:41.838746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.850165 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1080caaa-099f-413a-8266-dd75e7394e2d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.239981 Jul 20 19:29:41.851142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 116/252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:42.034602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f37c9ec7-c260-47a1-b277-7547eb053835 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85e5f430>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.076998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f37c9ec7-c260-47a1-b277-7547eb053835 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.046803 Jul 20 19:29:42.077572 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 137/253] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:42.847736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.848337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.855241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.855684 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.856535 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.857002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.870369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.870974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.877182 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.877629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.878397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.878822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.066070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.073969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.074885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-edcf3a19-c3ae-4101-9bec-0cefc3621744 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.230970 Jul 20 19:29:43.075707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 117/254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:43.081761 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2bd09e21-be88-4b60-b246-fcfa23bb94a7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.216122 Jul 20 19:29:43.082333 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 138/255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:43.089103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dafcd4c6-cdcd-4675-ba1c-9ae8b558e35d tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e86038ee0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.120061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dafcd4c6-cdcd-4675-ba1c-9ae8b558e35d tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.034784 Jul 20 19:29:43.120641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 118/256] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:44.092112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.092713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.100588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.100588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.101800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.104307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.105852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.107363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.107521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.108108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.109101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.109679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.114003 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:44.322223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.325440 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.329873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5c6972ad-a2bc-44fb-9711-bbf8172cb620 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.234786 Jul 20 19:29:44.330457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 119/257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:44.333556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1ed53e16-22d7-44bf-bc5c-14accae4545a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.245088 Jul 20 19:29:44.335067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 139/258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:44.336911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6262ae84-00e1-49a9-8094-198089afd91d tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e8601a670>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.339883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-1e31d6fe-108c-4edf-8ff2-d06585b70d0c req-32f7d8fe-9075-4215-845b-7b2c567364d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac8e4a2-4d14-4122-a963-6b8db3d39f3d", "tag": "b89d5bd5-4a69-49c7-ac4b-30e7fb240a41"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:44.351160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-1e31d6fe-108c-4edf-8ff2-d06585b70d0c req-32f7d8fe-9075-4215-845b-7b2c567364d5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.351683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-1e31d6fe-108c-4edf-8ff2-d06585b70d0c req-32f7d8fe-9075-4215-845b-7b2c567364d5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.363770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-1e31d6fe-108c-4edf-8ff2-d06585b70d0c req-32f7d8fe-9075-4215-845b-7b2c567364d5 service nova] Creating event network-changed:b89d5bd5-4a69-49c7-ac4b-30e7fb240a41 for instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d on hv-cinder-85054 Jul 20 19:29:44.369443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-1e31d6fe-108c-4edf-8ff2-d06585b70d0c req-32f7d8fe-9075-4215-845b-7b2c567364d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Jul 20 19:29:44.370028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 140/259] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:44.373516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6262ae84-00e1-49a9-8094-198089afd91d tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 287 microversion: 2.1 time: 0.041881 Jul 20 19:29:44.374150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 120/260] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:44.388754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-834ec75e-0c33-4b11-a19c-53325a277733 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85d9eaf0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.450907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-834ec75e-0c33-4b11-a19c-53325a277733 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 202 len: 0 microversion: 2.1 time: 0.068485 Jul 20 19:29:44.451524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 141/261] 10.222.0.79 () {58 vars in 1253 bytes} [Wed Jul 20 19:29:44 2022] DELETE /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:29:44.460556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-550ddca7-9b1d-4736-b654-d14088530664 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85fc7e50>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.497971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-550ddca7-9b1d-4736-b654-d14088530664 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 200 len: 286 microversion: 2.1 time: 0.041723 Jul 20 19:29:44.498549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 121/262] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:45.348068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.348764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:45.359283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.361127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:45.367312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.367949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.369482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.370893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.376331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.377063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.378259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:45.380325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:45.608213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.613383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:45.622630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-81be1e33-31e9-482b-9b2e-7247487663c6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.270684 Jul 20 19:29:45.623387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 122/263] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:45.628356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7159a4e1-2061-4b97-a1d8-52af31f4ff05 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e8604ca60>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.636255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6cce4ce8-abc0-4b79-b37e-d8755acfe14d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.292638 Jul 20 19:29:45.637009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 142/264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:45.659954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-7159a4e1-2061-4b97-a1d8-52af31f4ff05 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] HTTP exception thrown: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7159a4e1-2061-4b97-a1d8-52af31f4ff05 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Request method failure captured: Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 HTTP/1.1 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FehvVCH7Xo89tqIJD23Yuupw9VS5jb8A2NJnUXCVyLggjBWiQ8_bxtqXXpoAEb_v-QhPk1gjBWU4vx3FQAiwglRWZlQbMQidSMEqTfPgA9XNUUGKfykHmVA6Yg6Ks4NulXXXij2c81bQsMEzEprM1LTSXi6NP-fu9s4gLHSueXRcrw Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:29:45.662567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_16b434ffed9f4a218fae3443c7cc7d31", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: a6f377b5eca84b60b2dac22f24840017 Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'bdc3b035-c68f-4a0b-a561-f621f82ad1b2'} Jul 20 19:29:45.663992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. (HTTP 404) (Request-ID: req-c9240475-74ca-4067-9a8f-91aa10d83752) Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.664842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:45.666133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 19:29:45.668023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7159a4e1-2061-4b97-a1d8-52af31f4ff05 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Returning 404 to user: Snapshot bdc3b035-c68f-4a0b-a561-f621f82ad1b2 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7159a4e1-2061-4b97-a1d8-52af31f4ff05 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2" status: 404 len: 111 microversion: 2.1 time: 0.039564 Jul 20 19:29:45.669515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 123/265] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/os-snapshots/bdc3b035-c68f-4a0b-a561-f621f82ad1b2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:45.675446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b6f2b353-61c8-4bb3-91d8-55542ab9f5e2 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85d970d0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.751627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b6f2b353-61c8-4bb3-91d8-55542ab9f5e2 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 202 len: 0 microversion: 2.1 time: 0.079959 Jul 20 19:29:45.752708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 143/266] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:29:45 2022] DELETE /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:45.763881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-18627bb2-282c-42cd-9197-04182411a21b tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85fc7c10>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:45.842179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-18627bb2-282c-42cd-9197-04182411a21b tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 200 len: 345 microversion: 2.1 time: 0.084436 Jul 20 19:29:45.844846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 124/267] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:46.642507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.644047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:46.653737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.655210 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:46.666271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.666734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.667516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.667951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.672851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.673675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.674707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.675286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.926246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.956718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2b68b423-4fc2-4eb9-a374-6669e3eb7b2a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.306675 Jul 20 19:29:46.957425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 125/268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:46 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:46.957651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.970563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-82fd415e-21a1-41dd-b0eb-fac27c1898db tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85fc7e50>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.970713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-31190f99-13b2-4f62-b40a-47214a731301 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.332431 Jul 20 19:29:46.972111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 144/269] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:46 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:47.005297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-82fd415e-21a1-41dd-b0eb-fac27c1898db tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] HTTP exception thrown: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-82fd415e-21a1-41dd-b0eb-fac27c1898db tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Request method failure captured: Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 HTTP/1.1 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FehvVCH7Xo89tqIJD23Yuupw9VS5jb8A2NJnUXCVyLggjBWiQ8_bxtqXXpoAEb_v-QhPk1gjBWU4vx3FQAiwglRWZlQbMQidSMEqTfPgA9XNUUGKfykHmVA6Yg6Ks4NulXXXij2c81bQsMEzEprM1LTSXi6NP-fu9s4gLHSueXRcrw Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:29:47.007526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_16b434ffed9f4a218fae3443c7cc7d31", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: a6f377b5eca84b60b2dac22f24840017 Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '6c85dcc9-25ca-4170-9f50-c1a424a18ef2'} Jul 20 19:29:47.008675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. (HTTP 404) (Request-ID: req-01d6a6eb-bec3-436b-b2c7-7d4bbd290a38) Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.009691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:47.010688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:29:47.011757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-82fd415e-21a1-41dd-b0eb-fac27c1898db tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Returning 404 to user: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-82fd415e-21a1-41dd-b0eb-fac27c1898db tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 404 len: 109 microversion: 2.1 time: 0.050490 Jul 20 19:29:47.012762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 126/270] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:46 2022] GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:47.034192 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3a1366f5-7f62-4fe3-9840-123e7a5e463a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e85d9eaf0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.067128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-3a1366f5-7f62-4fe3-9840-123e7a5e463a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] HTTP exception thrown: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3a1366f5-7f62-4fe3-9840-123e7a5e463a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Request method failure captured: Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: DELETE /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 HTTP/1.1 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FehvVCH7Xo89tqIJD23Yuupw9VS5jb8A2NJnUXCVyLggjBWiQ8_bxtqXXpoAEb_v-QhPk1gjBWU4vx3FQAiwglRWZlQbMQidSMEqTfPgA9XNUUGKfykHmVA6Yg6Ks4NulXXXij2c81bQsMEzEprM1LTSXi6NP-fu9s4gLHSueXRcrw Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:29:47.070973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_16b434ffed9f4a218fae3443c7cc7d31", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: a6f377b5eca84b60b2dac22f24840017 Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '6c85dcc9-25ca-4170-9f50-c1a424a18ef2'} Jul 20 19:29:47.072148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. (HTTP 404) (Request-ID: req-0b2446ca-619a-4d72-ba22-fdda613f29db) Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.072858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:29:47.073901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:29:47.075399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3a1366f5-7f62-4fe3-9840-123e7a5e463a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Returning 404 to user: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3a1366f5-7f62-4fe3-9840-123e7a5e463a tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 404 len: 109 microversion: 2.1 time: 0.042524 Jul 20 19:29:47.076600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 145/271] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:29:47 2022] DELETE /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:47.085686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d6e8d37-4c52-41d4-8204-1e32953793e6 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Calling method '.version_select at 0x7f0e86038ee0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.126384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-1d6e8d37-4c52-41d4-8204-1e32953793e6 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] HTTP exception thrown: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d6e8d37-4c52-41d4-8204-1e32953793e6 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Request method failure captured: Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 HTTP/1.1 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FehvVCH7Xo89tqIJD23Yuupw9VS5jb8A2NJnUXCVyLggjBWiQ8_bxtqXXpoAEb_v-QhPk1gjBWU4vx3FQAiwglRWZlQbMQidSMEqTfPgA9XNUUGKfykHmVA6Yg6Ks4NulXXXij2c81bQsMEzEprM1LTSXi6NP-fu9s4gLHSueXRcrw Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:29:47.129505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_16b434ffed9f4a218fae3443c7cc7d31", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/16b434ffed9f4a218fae3443c7cc7d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 16b434ffed9f4a218fae3443c7cc7d31 Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-682230013 Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: a6f377b5eca84b60b2dac22f24840017 Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesSnapshotsTestJSON-682230013-project Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '6c85dcc9-25ca-4170-9f50-c1a424a18ef2'} Jul 20 19:29:47.130797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. (HTTP 404) (Request-ID: req-967c60c5-a1a0-4a9d-9acc-9d269e2d9c6b) Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.131505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:47.133532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:29:47.135067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d6e8d37-4c52-41d4-8204-1e32953793e6 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] Returning 404 to user: Volume 6c85dcc9-25ca-4170-9f50-c1a424a18ef2 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1d6e8d37-4c52-41d4-8204-1e32953793e6 tempest-VolumesSnapshotsTestJSON-682230013 tempest-VolumesSnapshotsTestJSON-682230013-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2" status: 404 len: 109 microversion: 2.1 time: 0.052293 Jul 20 19:29:47.137959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 127/272] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/os-volumes/6c85dcc9-25ca-4170-9f50-c1a424a18ef2 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:47.976594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.977382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:47.985498 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.986129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.986555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:47.986977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.987707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.991837 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.992461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:48.005931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.006447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.008690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.010213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.090276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=8 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:48.186845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.195864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2f39afc6-1036-4dde-b638-48788d7aa0b7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.225152 Jul 20 19:29:48.205130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 146/273] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:48.273117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.281858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7e724c12-165d-4f55-97c6-87b50850da14 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.296524 Jul 20 19:29:48.282819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 128/274] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:49.214935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.216376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:49.225351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.225887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.227149 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.227800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.300951 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.302800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:49.310162 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.311138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.312088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.312701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.440223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.449799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e26e88da-12cb-4ab1-a8ad-509e15859255 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.239874 Jul 20 19:29:49.450378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 147/275] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:49.456095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1241663258", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006792000", "security_groups": [{"name": "tempest-secgroup-smoke-7941455"}], "block_device_mapping_v2": [{"uuid": "d6a2a4ca-58e8-44ad-9af9-89d9dcd09c5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:49.500497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.513045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f9900c10-db04-4aa8-a09b-f59683d31760 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.217000 Jul 20 19:29:49.514834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 129/276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:49.583930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] validate_networks() for [('bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:29:50.236993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:29:50.237635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:29:50.238235 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:29:50.238755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:29:50.239359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:29:50.249537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.250184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.250986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.251424 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.271959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:29:50.276574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for user 493d126879f44b26951920235e7f7730 and project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:29:50.343855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:29:50.345977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6a2a4ca-58e8-44ad-9af9-89d9dcd09c5f',volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:29:50.468092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.468764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.476355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.476823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.478002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.478446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.509060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-885d7421-cb46-4242-b0e8-fab1d9b8aeaa tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.057377 Jul 20 19:29:50.509898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 148/277] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:29:49 2022] POST /compute/v2.1/servers => generated 403 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:29:50.519737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c0f3f80b-08cc-4c17-8209-c139b810a9fd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.521301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c0f3f80b-08cc-4c17-8209-c139b810a9fd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.622096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c0f3f80b-08cc-4c17-8209-c139b810a9fd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.636187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c0f3f80b-08cc-4c17-8209-c139b810a9fd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1095 microversion: 2.1 time: 0.120400 Jul 20 19:29:50.637253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 149/278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:50.641987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.642755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.662422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.663073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.664195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.664801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.737562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.751750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e3e97188-af33-4755-a152-8857f66f7557 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.288138 Jul 20 19:29:50.753093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 130/279] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:50.894402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:50.904305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c57125ba-c3a5-47c0-b297-b3afe9c55bb1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.265809 Jul 20 19:29:50.906025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 150/280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:51.133080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-3cdb92e9-b41b-46ba-8d4b-a9c2e0cdf20e req-8a9801d3-7534-4e83-bea3-ee8cb9660415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac8e4a2-4d14-4122-a963-6b8db3d39f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b89d5bd5-4a69-49c7-ac4b-30e7fb240a41"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:51.141840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3cdb92e9-b41b-46ba-8d4b-a9c2e0cdf20e req-8a9801d3-7534-4e83-bea3-ee8cb9660415 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.142424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3cdb92e9-b41b-46ba-8d4b-a9c2e0cdf20e req-8a9801d3-7534-4e83-bea3-ee8cb9660415 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.155899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-3cdb92e9-b41b-46ba-8d4b-a9c2e0cdf20e req-8a9801d3-7534-4e83-bea3-ee8cb9660415 service nova] Creating event network-vif-plugged:b89d5bd5-4a69-49c7-ac4b-30e7fb240a41 for instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d on hv-cinder-85054 Jul 20 19:29:51.162950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-3cdb92e9-b41b-46ba-8d4b-a9c2e0cdf20e req-8a9801d3-7534-4e83-bea3-ee8cb9660415 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034931 Jul 20 19:29:51.164449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 131/281] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:51.653075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:51.653707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:51.660918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.661468 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.662244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.662670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.727268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.734926 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e92babfb-4f08-4e78-be91-274b05dad796 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1193 microversion: 2.1 time: 0.085708 Jul 20 19:29:51.735484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 151/282] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:51 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:51.771848 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:51.772548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:51.778796 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.779244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.780020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.780453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.922816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.923221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:51.923825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:51.930476 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.930925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.931087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5ddab57c-64ae-4605-808b-b5a1823cab91 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.163833 Jul 20 19:29:51.931692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:51.931808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 132/283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:51 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:51.932120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.087340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.103485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fd6e5951-e21e-411e-8d26-1ee9849c1342 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.184095 Jul 20 19:29:52.104068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 152/284] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:51 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:52.753247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.753868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.760860 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.761364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.762176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.762692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.828498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.836854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3e47d327-ed2c-41af-9863-994ea5b90036 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1211 microversion: 2.1 time: 0.087570 Jul 20 19:29:52.837440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 133/285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:52.948903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.949488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.956102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.956616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.957410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.957896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.087860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.095306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3899107c-741b-4826-88b3-d95ff885e61a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1319 microversion: 2.1 time: 0.150724 Jul 20 19:29:53.095867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 153/286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:53.119598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:53.120188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:53.126214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.126671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.127433 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.127872 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.469486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.479418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fefb9ece-7a6f-43f1-bdc6-e0e13e3fd38c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.363608 Jul 20 19:29:53.489977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 134/287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:53 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:53.863401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:53.864580 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:53.866779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:53.873327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.874927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.875788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.876231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.076387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.085086 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-03b7a286-62e1-4fa1-9e8b-2e15a1425e4a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1276 microversion: 2.1 time: 0.234903 Jul 20 19:29:54.085892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 154/288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:53 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:54.112953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.113557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.119859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.120464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.121467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.122180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.268258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.276720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e3dd8b8b-8a0c-4c13-b321-42f56a5e4798 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1508 microversion: 2.1 time: 0.167629 Jul 20 19:29:54.277310 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 135/289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:54.498319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.499509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.506800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.507330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.508227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.508832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.774738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.786933 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cfdf5d52-919c-4a5f-a61f-ca0f4380343f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.291766 Jul 20 19:29:54.794319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 155/290] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:55.107656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.108577 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.116264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.117854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.119250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.119894 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.421956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.431989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b802d178-dc3b-4c73-b381-9536a2fb9ad2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.331595 Jul 20 19:29:55.448909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 136/291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:55.546995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-07bdb48b-b473-47ce-875e-cb0fcaca6c12 req-4967feca-fc5c-4564-a70d-52ce726b4c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000b3a8a-e2f6-4b99-b44b-add74e40f420", "tag": "caa55c24-a3af-4dbe-9f01-010be87c9cc7"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:55.568087 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-07bdb48b-b473-47ce-875e-cb0fcaca6c12 req-4967feca-fc5c-4564-a70d-52ce726b4c94 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.569079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-07bdb48b-b473-47ce-875e-cb0fcaca6c12 req-4967feca-fc5c-4564-a70d-52ce726b4c94 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.600444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-07bdb48b-b473-47ce-875e-cb0fcaca6c12 req-4967feca-fc5c-4564-a70d-52ce726b4c94 service nova] Creating event network-changed:caa55c24-a3af-4dbe-9f01-010be87c9cc7 for instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 on hv-cinder-85054 Jul 20 19:29:55.607522 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-07bdb48b-b473-47ce-875e-cb0fcaca6c12 req-4967feca-fc5c-4564-a70d-52ce726b4c94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064173 Jul 20 19:29:55.608016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 156/292] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:55.808117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.809019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.815219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.815691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.816847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.817024 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.998297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.023776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-56c96b14-6726-419b-86b0-bcb082d263b0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.206508 Jul 20 19:29:56.025887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 137/293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:56.450453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.451148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.457328 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.458387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.459416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.459850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.604146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.617325 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9e09b4f7-959b-48c3-abed-8d9e2ffd0541 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.167905 Jul 20 19:29:56.625276 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 157/294] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:56 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:57.043201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:57.043989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:57.050224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:57.051314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.052362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.053087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.053544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.224576 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:57.233581 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7c314223-461e-4a90-bc1a-d0536623de26 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.195460 Jul 20 19:29:57.234541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 138/295] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:57 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:57.633547 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:57.634102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:57.640758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.641321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.642330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.642937 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.080045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.088521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-16134964-5aa3-4fca-b890-77ff62be8b68 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.460085 Jul 20 19:29:58.089423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 158/296] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:57 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:58.251466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:58.252089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:58.258623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.259085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.259879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.260468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.526850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.537969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e90066a3-94f0-4fcf-a56c-fe782d2dce1d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.290987 Jul 20 19:29:58.538565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 139/297] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:58 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:59.105941 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.106623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.113149 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.113807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.115150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.115664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.280769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.291228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1ed13021-4f03-4b96-b05a-8a2e00eeb6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.189263 Jul 20 19:29:59.291841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 159/298] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:59.556496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.557717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.564079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.565140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.566206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.567836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.587492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:59.759959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.788343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-61c3f765-8a11-4c87-b0bd-3c45543e270e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.237264 Jul 20 19:29:59.793807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 140/299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:00.312621 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.313988 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.323096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:00.326746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.327769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.329439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.330108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.503379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.514606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-167d0ba2-7be0-4108-ac3c-93e102d430c7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.209070 Jul 20 19:30:00.515456 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 160/300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:00.811111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.811819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.820778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.821444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.822468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.823151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.035038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.045755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e93df11d-2347-4cbe-99eb-e57ee516019d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.238381 Jul 20 19:30:01.046344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 141/301] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:01.533764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:01.534376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:01.544440 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=8 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:01.552221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.555424 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.556336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.556789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.744361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.747808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:01.753825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a07db8b9-8f33-4c55-bb65-f07866d6716b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.224722 Jul 20 19:30:01.755017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 161/302] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:01 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:02.062993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.063600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.070262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.070717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.071497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.071937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.235122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.244084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-83cd6843-ae6f-4851-a4bf-2f5b1c1365b7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.185363 Jul 20 19:30:02.253655 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 142/303] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:02.777074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.777698 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.805947 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.806938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.808190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.808789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.042081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:03.054896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-493562a0-8cdb-4575-9a9f-b415004e35d7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.285705 Jul 20 19:30:03.056416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 162/304] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:03.262632 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:03.264413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:03.271280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.271909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.272687 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.273191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.429518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:03.438442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-48aaa2fe-39c9-4f62-b3f9-d57e978bb979 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.181057 Jul 20 19:30:03.439450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 143/305] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:03 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:04.073689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:04.075123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:04.084973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.085782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:04.086756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.087385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:04.297631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.306467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0042b4af-7523-40e6-a01b-c5634bf55238 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.236811 Jul 20 19:30:04.315076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 163/306] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:04 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:04.456669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:04.457409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:04.474200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.477429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:04.478456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:04.478970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:04.845232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.857146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e35ac8b3-cd38-4917-89f1-a0f13684f5be tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.405293 Jul 20 19:30:04.857745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 144/307] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:04 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:05.324841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:05.325557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:05.333068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.333936 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.334797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.335304 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.586798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.596222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-96b56992-4071-424a-bd0e-e21dd9082633 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.275234 Jul 20 19:30:05.599727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 164/308] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:05 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:05.874626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:05.877541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:05.895761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.896661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.897752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.898443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.576338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.593994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-62ca98a0-6fa3-46cb-90d3-51f5dbef7c39 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.723402 Jul 20 19:30:06.596963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 145/309] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:05 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:06.626696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:06.627554 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:06.639491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.640229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.641341 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.643082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.032120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.042918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a6d31e0f-2810-4bd8-b208-feba7e216842 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.428869 Jul 20 19:30:07.058900 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 165/310] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:06 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:07.615075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:07.616379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:07.632964 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.633789 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.635034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.635751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.991857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.999774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a55bb0e2-497b-4d36-b21a-ccb425115a9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.391046 Jul 20 19:30:08.000361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 146/311] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:07 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:08.065948 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:08.067635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:08.079496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.080016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.089076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.089519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.495201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.503928 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8a49c6bc-1002-419d-83f5-22a01601a61e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.442093 Jul 20 19:30:08.506759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 166/312] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:08 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:08.792502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-dd13b06c-6028-4888-8598-853e6a0ebcbb req-18484c84-1a55-44a0-9497-62e69438e6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000b3a8a-e2f6-4b99-b44b-add74e40f420", "name": "network-vif-plugged", "status": "completed", "tag": "caa55c24-a3af-4dbe-9f01-010be87c9cc7"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:08.808533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-dd13b06c-6028-4888-8598-853e6a0ebcbb req-18484c84-1a55-44a0-9497-62e69438e6e6 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.813151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-dd13b06c-6028-4888-8598-853e6a0ebcbb req-18484c84-1a55-44a0-9497-62e69438e6e6 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.848769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-dd13b06c-6028-4888-8598-853e6a0ebcbb req-18484c84-1a55-44a0-9497-62e69438e6e6 service nova] Creating event network-vif-plugged:caa55c24-a3af-4dbe-9f01-010be87c9cc7 for instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 on hv-cinder-85054 Jul 20 19:30:08.867067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-dd13b06c-6028-4888-8598-853e6a0ebcbb req-18484c84-1a55-44a0-9497-62e69438e6e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086856 Jul 20 19:30:08.867690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 147/313] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:09.017897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.018519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:09.028276 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.028733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.029767 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.030393 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.303681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.317773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-79ae2fb8-7858-4479-afae-63c8e6af4ac7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.303665 Jul 20 19:30:09.330959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 167/314] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:09 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:09.525670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.526543 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:09.563259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.565076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.568172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.570325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.847333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:09.855301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4489d323-c4f6-4720-b16f-f64b0eb3f627 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.334916 Jul 20 19:30:09.862471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 148/315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:09 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:10.336172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:10.337023 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:10.347316 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.351871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.353684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.354266 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.623694 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:10.638898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a8947b8f-b230-4aae-8a5a-01bc99cb0cd6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.306700 Jul 20 19:30:10.651925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 168/316] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:10 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:10.879850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:10.881085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:10.901221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.901919 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:10.902864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:10.903469 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:11.107230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:11.118417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b21557f5-35b9-4355-a836-bf3b2505958c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1264 microversion: 2.1 time: 0.241590 Jul 20 19:30:11.119011 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 149/317] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:10 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:11.660038 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:11.663237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:11.670652 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:11.671095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:11.672049 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:11.672639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:11.854378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:11.862934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-015b59b9-14cb-4ee9-9bed-b8090b0122bf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.209591 Jul 20 19:30:11.864861 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 169/318] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:11 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:12.140345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.141344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.151830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.153284 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.154384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.155033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.358417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.366960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-22491f80-8e6e-44f8-8368-e42ce3546944 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1452 microversion: 2.1 time: 0.231294 Jul 20 19:30:12.369169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 150/319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:12 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:12.394299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.395850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.402865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.403700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.405271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.406040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.567870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:12.577256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d5d7166e-2d60-4fa6-8eb1-f3bf3d9f3121 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1452 microversion: 2.1 time: 0.192371 Jul 20 19:30:12.578061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 170/320] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:12 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:12.895744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.896601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.904283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.904934 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.905871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.906306 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.109212 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:13.120613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b169f85a-766e-497b-92cf-f9215c703579 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.239856 Jul 20 19:30:13.122237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 151/321] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:12 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:14.141714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:14.142927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:14.152853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.153426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.154302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:14.154825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:14.340923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:14.351329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0eb4d970-ac1e-4508-a17d-ae15df5c8c31 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.217204 Jul 20 19:30:14.361459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 171/322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:14 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:15.142683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-71c21974-7fd0-4c82-b157-37fa4fb659ac req-b42a2476-4575-4e7f-addb-653f99d66ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000b3a8a-e2f6-4b99-b44b-add74e40f420", "tag": "caa55c24-a3af-4dbe-9f01-010be87c9cc7"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:15.154634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-71c21974-7fd0-4c82-b157-37fa4fb659ac req-b42a2476-4575-4e7f-addb-653f99d66ae8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.155203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-71c21974-7fd0-4c82-b157-37fa4fb659ac req-b42a2476-4575-4e7f-addb-653f99d66ae8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.171092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-71c21974-7fd0-4c82-b157-37fa4fb659ac req-b42a2476-4575-4e7f-addb-653f99d66ae8 service nova] Creating event network-changed:caa55c24-a3af-4dbe-9f01-010be87c9cc7 for instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 on hv-cinder-85054 Jul 20 19:30:15.177426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-71c21974-7fd0-4c82-b157-37fa4fb659ac req-b42a2476-4575-4e7f-addb-653f99d66ae8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038445 Jul 20 19:30:15.184051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 152/323] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:15.368097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:15.368710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:15.376154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.399069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.399069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:15.399069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:15.648072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:15.666990 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f92c618d-fdda-475d-bcb4-d59e929bdf65 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.298789 Jul 20 19:30:15.669134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 172/324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:15 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:16.686885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:16.688135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:16.696172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.696986 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:16.697999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:16.698600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.027961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:17.037143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f55796ba-e511-476a-abb6-b28bb0215a79 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.354604 Jul 20 19:30:17.055082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 153/325] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:16 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:17.669225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:17.669705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:17.685281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.685281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.685281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:17.685281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:17.736441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8ebf3a31-a0a6-427d-aa53-8dfd341e38c8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/ips" status: 200 len: 145 microversion: 2.1 time: 0.071946 Jul 20 19:30:17.737582 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 173/326] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:30:17 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/ips => generated 145 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:18.062300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:18.064784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:18.077857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:18.078887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:18.080019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:18.080911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:18.356977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:18.367227 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d04fd162-b922-4fbc-88c4-d0b4b410c50d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.311410 Jul 20 19:30:18.367884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 154/327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:18 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:19.384569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:19.385223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:19.395550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.399426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.400864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:19.401340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:19.600130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:19.611501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d4d20172-4e5e-4a53-9f45-da378a89aba6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.231093 Jul 20 19:30:19.630728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 174/328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:19 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:20.637731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:20.638361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:20.645985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.646475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.647437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:20.647890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:20.854805 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:20.878793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3e3234e0-bd2e-4ced-b200-455edb25a986 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.253349 Jul 20 19:30:20.880449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 155/329] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:20 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:21.896589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:21.897262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:21.917949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.918798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:21.929441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:21.929441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:22.119984 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:22.131983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6680dbd6-48f8-4c42-9fd7-e01eee48065e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1520 microversion: 2.1 time: 0.239320 Jul 20 19:30:22.137033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 175/330] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:21 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:23.099113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "568556f3-084f-4242-bf28-97a0482b7399"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:23.100203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:23.106825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.107525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.108504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.108970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.165018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:23.165641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:23.179699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.180168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.184374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.185796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.472663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.481826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8d1bf726-bd24-40d6-be8a-a01c835ac538 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1500 microversion: 2.1 time: 0.334141 Jul 20 19:30:23.493058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 176/331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:23 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1500 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:23.498986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:23.500123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:23.509527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.510356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.511410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:23.511960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:23.646242 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d4d0312e-9adc-48cc-9fe6-a5e7ac281be9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550195 Jul 20 19:30:23.648992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 156/332] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:30:23 2022] POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:23.721078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:23.735537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6239bfd7-b65e-4227-a326-f52704cde198 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1515 microversion: 2.1 time: 0.240309 Jul 20 19:30:23.757168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 177/333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:23 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:26.401765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:26.403030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:26.411715 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.412299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.413252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.413982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.417075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:26.447700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lazy-loading 'flavor' on Instance uuid 0e030ad0-4549-4070-bf06-563e23b2dce5 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:30:26.560138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-29ae9fa8-ee2b-4837-bb55-d141fe8d92fb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/action" status: 200 len: 32 microversion: 2.1 time: 0.166236 Jul 20 19:30:26.561663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 157/334] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:30:26 2022] POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:30:26.571106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:26.571964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:26.574995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=48 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:26.581097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.581909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.583357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:26.583888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:26.824390 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:26.828647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:26.842142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-437aa0c1-8c05-4bb9-860c-5c14b9ef7545 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.269363 Jul 20 19:30:26.845743 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 178/335] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:26 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:27.562411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-96b37829-077e-4b91-9c91-a6ac04033316 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'create', calling method: .version_select at 0x7f0e85ecc160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1004681381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMev2xdjK3qVMi8u3ikDt1DYkLCmpvzecTil7JGRcKGH0467YUX1BiJxx2qMGGF0jx2/O73on3IO1Jr5AlNWIApu69L05h8l0EoD1bLpYaDvaNM4Ow8SWPRcDtQaETjKXw=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:27.571803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=40 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:27.583351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-96b37829-077e-4b91-9c91-a6ac04033316 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Getting quotas for project 91e1220a765f41e88d4e3480b9a7a687. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:27.588224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-96b37829-077e-4b91-9c91-a6ac04033316 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Getting quotas for user 43929f4dcce44f3bac9fd69cf960c985 and project 91e1220a765f41e88d4e3480b9a7a687. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:27.612720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-96b37829-077e-4b91-9c91-a6ac04033316 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054661 Jul 20 19:30:27.613889 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 158/336] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:30:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:27.667147 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2016333186", "imageRef": "3db96a6f-1c3c-40ca-8cdb-5ff992dbbf93", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1004681381", "networks": [{"uuid": "1e189f3c-62d8-4a6b-a167-08b9a7c92e37"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:27.726986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] validate_networks() for [('1e189f3c-62d8-4a6b-a167-08b9a7c92e37', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:30:27.863719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:27.864468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:27.873702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.874402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:27.875361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:27.875814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.113388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.120288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9aeca37d-7d59-43f0-a99c-fb905ca25f9e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.260674 Jul 20 19:30:28.121205 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 159/337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:27 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:28.220227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:30:28.220653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:30:28.221155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:30:28.221560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:30:28.224950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:30:28.234700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.235174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.235968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:28.236588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:28.259470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Getting quotas for project 91e1220a765f41e88d4e3480b9a7a687. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:28.263835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Getting quotas for user 43929f4dcce44f3bac9fd69cf960c985 and project 91e1220a765f41e88d4e3480b9a7a687. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:28.277046 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:30:28.279439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3db96a6f-1c3c-40ca-8cdb-5ff992dbbf93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:30:28.337221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-07ce83f2-cb07-45a5-a271-31c5b0c806f3 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674228 Jul 20 19:30:28.338118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 179/338] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:30:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:30:28.350135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5006f23b-da13-41f6-9056-220d452b86b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:28.350761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5006f23b-da13-41f6-9056-220d452b86b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:28.443343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5006f23b-da13-41f6-9056-220d452b86b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:28.460982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5006f23b-da13-41f6-9056-220d452b86b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1259 microversion: 2.1 time: 0.116469 Jul 20 19:30:28.461579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 160/339] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:28 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:29.138329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:29.139629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:29.148445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.149044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.149815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.152594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.318319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.326130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ddbbb812-5b71-4bcc-8e29-dda79777e19c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.192043 Jul 20 19:30:29.326727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 180/340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:29 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:29.478114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:29.479084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:29.489131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.489780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.490678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:29.495116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:29.575580 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:29.584584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3bab5754-9749-44c2-b052-0342a78dd868 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1311 microversion: 2.1 time: 0.110642 Jul 20 19:30:29.585496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 161/341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:29 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:30.343835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:30.344466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:30.353641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.354849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.355661 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.356094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.581379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:30.592529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a73cff34-9f71-4e21-a9ac-d48faa0fd5fc tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.252494 Jul 20 19:30:30.594701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 181/342] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:30 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:30.608382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:30.609266 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:30.620475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.621227 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:30.623280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:30.623902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.005850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:31.018494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9b9318c1-3383-4ce9-a5a3-4d710749660c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1317 microversion: 2.1 time: 0.416022 Jul 20 19:30:31.020284 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 162/343] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:30 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:31.613487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:31.614118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:31.631379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.632048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.634557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:31.636730 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:31.856673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:31.890758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ca5cdc3c-33fc-4da2-baa4-f6b87c5fc902 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.282756 Jul 20 19:30:31.891372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 182/344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:31 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:32.037456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:32.038095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:32.044695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:32.049262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:32.050510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:32.051988 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:32.223768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:32.236996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-57c45864-ec70-4e10-bdb7-9a991d2ca183 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.204250 Jul 20 19:30:32.237584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 163/345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:32 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:32.907990 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:32.908633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:32.916511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:32.917194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:32.919511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:32.920032 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.073676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.082477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6ed1f906-4724-4e27-8ae5-e04109b7b869 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.178051 Jul 20 19:30:33.083868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 183/346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:32 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:33.255471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:33.256154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:33.263599 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.264230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.265121 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:33.265799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:33.514548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:33.526455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-48fc61ac-93ce-401e-b4f4-5eecaa21d3ca tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.275510 Jul 20 19:30:33.527769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 164/347] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:33 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:34.101388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:34.117145 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:34.132766 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.133469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.134437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.135255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.380359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.390029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-10069b28-ef8e-461d-a48c-c79d7255a711 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.293893 Jul 20 19:30:34.391194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 184/348] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:34 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:34.530564 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:34.531143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:34.542844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.543740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.545078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.549917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:34.550548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.553599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:34.568121 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.569201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.575569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:34.576255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:34.593697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0fac999a-d20d-4f9d-b30c-452eec0f6187 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/ips" status: 200 len: 152 microversion: 2.20 time: 0.070488 Jul 20 19:30:34.594665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 165/349] 10.222.0.79 () {60 vars in 1288 bytes} [Wed Jul 20 19:30:34 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/ips => generated 152 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:30:34.781495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:34.801599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-67327c5c-d3f8-43ce-9977-e7ed0c07fd29 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.257559 Jul 20 19:30:34.802555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 185/350] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:34 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:35.408650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:35.409557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:35.417532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.417983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.419025 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.421395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.608098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:35.620301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-78f26efd-9c81-465b-bba9-34956b70549d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.216094 Jul 20 19:30:35.620966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 166/351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:35 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:35.827598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:35.828160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:35.836069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.836519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:35.839884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:35.841384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.049732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.058661 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-608389f0-9060-4128-bd92-3a092cac9985 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.240722 Jul 20 19:30:36.068200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 186/352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:35 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:36.638883 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:36.640313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:36.648665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.649363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.650282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:36.650874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:36.872912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:36.882424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1d93e630-be74-4cbe-b05e-81174110ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.247924 Jul 20 19:30:36.886477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 167/353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:36 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:37.072228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73519863-4c46-4e81-a479-617bf716f314", "device": "/dev/sdb"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:37.076280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:37.077518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:37.078827 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:37.089675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.090587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.091830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.092471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.093192 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.094236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.096272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.096706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.485630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:37.496833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fd43f9d2-0de4-4d9b-bd9b-ad6fdfb44528 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.425284 Jul 20 19:30:37.497626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 168/354] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:37 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:37.898890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:37.899542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:37.907468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.907929 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:37.908729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:37.909231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.119515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:38.131051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-301ab1c5-dc79-47fb-8a8c-3e96be33d9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.236205 Jul 20 19:30:38.131763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 169/355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:37 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:38.246417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.272274 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.514429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:38.515185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:38.517058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.522987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.523435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.524206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.524642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.694354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:38.705638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2fcd1b69-184b-4cee-83fc-a50cfac1d929 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.194892 Jul 20 19:30:38.706299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 170/356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:38 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:38.720311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:38.720974 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:38.729037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.729975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.730849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.731320 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.761697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lazy-loading 'flavor' on Instance uuid 27cf917f-83ab-47d0-82d4-8d8dc896aacb {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:30:39.170482 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-55904b68-365b-4e45-9edd-81b3cdc2dd55 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/action" status: 202 len: 0 microversion: 2.20 time: 0.462038 Jul 20 19:30:39.171183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 171/357] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 19:30:38 2022] POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:30:39.176298 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:39.177010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.183770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.184287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.185256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.185723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.190325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:39.376040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.386114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9a0eefde-1aed-4ab4-b906-1f668a2b30d8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.213732 Jul 20 19:30:39.386703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 172/358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:39 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:39.392398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:39.393262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.404010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.404547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.405382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.405831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.578615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.590136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.592282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.593530 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-05c0de5e-c5ee-4859-ac62-facf169c226d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.205914 Jul 20 19:30:39.594169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 173/359] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:39 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:39.726044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:39.727049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.733574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.734027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.734817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.735362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.894990 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.903768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-48e9183c-6992-4dc9-968a-be517942911e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.183955 Jul 20 19:30:39.904462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 174/360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:39 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:40.406153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.406791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.413740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.414187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.414963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.415402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.560667 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.569824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-61cc01ce-e180-47e8-b0b7-41e3d63d493f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.167542 Jul 20 19:30:40.570403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 175/361] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:40.618884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.619597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.625720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.626174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.626957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.627395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.794377 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.804470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.806517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.807982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-79ec7318-99af-4189-9260-b88abdbdfcd2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.193076 Jul 20 19:30:40.809158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 176/362] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:40.923186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.923820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.930551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.931004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.931787 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.932229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.072431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.088232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5632b72a-8cf1-4293-8a58-32cb499fda9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.169188 Jul 20 19:30:41.092923 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 177/363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:41.586996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:41.588370 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:41.595249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.595966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.596955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.598093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.776089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.787312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5707ae30-0d62-4b36-ad49-c6939e74466a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.203682 Jul 20 19:30:41.788922 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 178/364] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:41 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:41.827335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:41.828256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:41.838556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.841526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.842735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.843515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.006012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.036895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.043349 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.045529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b4603c43-bc71-4114-95df-a3e79c71b8c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.222162 Jul 20 19:30:42.046375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 179/365] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:41 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:42.111954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:42.114159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:42.122258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.122824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.124660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.125343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.293854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.303591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1fabaa37-af16-4f3b-a5fb-1438d6e55ae1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.195540 Jul 20 19:30:42.304491 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 180/366] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:42 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:42.808110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:42.809166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:42.815116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.815572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.817427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.818188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.002363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.010606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a8b28035-2126-4b78-9690-c416a593e80d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.206267 Jul 20 19:30:43.011763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 181/367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:42 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:43.064061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.064654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.071596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.072049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.072827 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.073366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.277188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.287540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.289152 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.290454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e29d9cd0-5b8d-4167-9139-a4e6043f157f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.230204 Jul 20 19:30:43.291064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 182/368] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:43.321143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.321761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.329254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.329709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.330493 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.330931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.507207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.515492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1acdd67c-9833-4413-915e-83a456f67f5b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.198241 Jul 20 19:30:43.516947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 183/369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:44.028513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.029981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.039608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.040333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.041378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.041821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.194415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.202127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e6eb46f8-d217-4ff3-a6c3-0d3580a7a67c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.178195 Jul 20 19:30:44.202718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 184/370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:44.311765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.312403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.319239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.319681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.320446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.320900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.460850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.468857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.470399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.471566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b93ecc98-6d40-4b56-a181-520bea0d9c95 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.163827 Jul 20 19:30:44.472617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 185/371] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:44.532970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.533620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.541142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.541603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.542392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.542837 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.676283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.683964 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-92b63a65-afff-4b59-a06c-34f8cf901e9e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.154892 Jul 20 19:30:44.684541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 186/372] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:45.222375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:45.225926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:45.233994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.234481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.235302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.235780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.386741 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.394544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3019f220-8dfe-41f1-bd97-137ac225aae3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.179184 Jul 20 19:30:45.395194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 187/373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:45 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:45.490904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:45.491859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:45.497878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.498331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.499124 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.499566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.636562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.638784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:45.645890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.648065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.649232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b4ab90a1-51f9-496a-807b-cd6fdd8587a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.162881 Jul 20 19:30:45.649803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 188/374] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:45 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:45.701432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:45.702038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:45.707946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.708393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.709724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.710152 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.845468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:45.853343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a2b6a6c3-6dc3-40ef-a8c0-e654cbfa1d52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.155702 Jul 20 19:30:45.853914 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 189/375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:45 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:46.412478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.413279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.420640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.421122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.421947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.422398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.634322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.645305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ecb536cc-829f-4e1e-9dac-cc23cf93ba04 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.237490 Jul 20 19:30:46.645928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 190/376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:46.667800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.668605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.675053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.675575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.676405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.676832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.873552 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.883945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.885825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.887023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f52aa5b4-9c85-4248-b879-45c101ac1f6d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.223140 Jul 20 19:30:46.887976 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 191/377] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:46.892589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-03a0d164-f9b4-44f7-a1cf-85154f0ed476 req-87c84e70-8300-4153-8175-a99659982a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:46.915101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-03a0d164-f9b4-44f7-a1cf-85154f0ed476 req-87c84e70-8300-4153-8175-a99659982a03 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.915567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-03a0d164-f9b4-44f7-a1cf-85154f0ed476 req-87c84e70-8300-4153-8175-a99659982a03 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.930283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-03a0d164-f9b4-44f7-a1cf-85154f0ed476 req-87c84e70-8300-4153-8175-a99659982a03 service nova] Creating event network-changed:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:30:46.937922 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-03a0d164-f9b4-44f7-a1cf-85154f0ed476 req-87c84e70-8300-4153-8175-a99659982a03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048690 Jul 20 19:30:46.938504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 192/378] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:46.944659 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.945497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.953037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.953757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.954839 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.955282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.088185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b8681c7e-f710-41f3-a05b-444ee38a8cfa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "POST /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.021477 Jul 20 19:30:47.089236 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 187/379] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:30:37 2022] POST /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d/os-volume_attachments => generated 194 bytes in 10023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:47.107142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.118618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-74273c87-c128-4d73-977b-86f932a2b2f1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.178661 Jul 20 19:30:47.119674 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 193/380] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:47.665551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.666260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.671114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:47.673976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.674415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.675448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.676058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.909053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.909805 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.910679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.919725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.920173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.920993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.921428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.921545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-73b45425-51d1-401a-a907-62247e9229a8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.262446 Jul 20 19:30:47.923487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 188/381] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:48.137686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.139045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.151668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.152618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.154485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.155126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.171733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.185289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.186808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.195692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ec3a7e6a-9f31-4e00-9224-8cddbf5a34db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.291641 Jul 20 19:30:48.197029 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 194/382] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:48.401469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.413697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-19a098e3-70b6-4ff2-9153-776873390e2d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.278492 Jul 20 19:30:48.414970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 189/383] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:48.600403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-553ceb8a-2554-4e06-bc53-30f0a2526e7e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:48.607191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-553ceb8a-2554-4e06-bc53-30f0a2526e7e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.607829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-553ceb8a-2554-4e06-bc53-30f0a2526e7e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.670763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-553ceb8a-2554-4e06-bc53-30f0a2526e7e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Going to try to stop instance {{(pid=117948) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 19:30:48.723926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-553ceb8a-2554-4e06-bc53-30f0a2526e7e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action" status: 202 len: 0 microversion: 2.1 time: 0.127676 Jul 20 19:30:48.724787 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 195/384] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:30:48 2022] POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:30:48.733588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.734219 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.742206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.742679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.743579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.744013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.941860 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.942413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.949750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.950297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.951023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.951455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.264186 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.275467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fcc89a2e-a088-4a43-8d23-30416103fab9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.546185 Jul 20 19:30:49.280090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.283132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 190/385] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:49.295581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:49.297697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fbae23a3-3314-43bd-ab60-c631d40027c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.361256 Jul 20 19:30:49.309719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:49.313020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 196/386] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:49.316576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.317408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.318410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.319305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.433287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:49.434357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:49.440703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.441502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.442536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.442963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.602551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.611449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.613109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.614191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-88732d59-0737-47b5-be11-072bdc78982b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.329834 Jul 20 19:30:49.614762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 191/387] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:49 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:49.667736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.677196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-753c2e50-091a-4c00-8d5a-78614d2ecfa1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.249526 Jul 20 19:30:49.686836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 197/388] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:49 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:50.294065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.294676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.301200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.301639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.302414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.303488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.315555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.316175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.324036 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.324489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.325296 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.325734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.497470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.506533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e039f0e1-e287-4719-a692-dc8117b757f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.215872 Jul 20 19:30:50.507400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 192/389] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:50.582368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.605703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-62e2749d-942f-44a3-962e-717daac2967e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.286493 Jul 20 19:30:50.607375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 198/390] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:50.633903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.634595 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.640585 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.641205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.642151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.642608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.705064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.705689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.718873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.719332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.720124 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.720572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.920088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.932589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.932589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.933037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9ce676e0-67a4-4236-a810-ed828ed12a16 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.304134 Jul 20 19:30:50.961454 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 193/391] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:50.967160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.977679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-682a77e5-5c42-459b-b0dd-379ca2ff3a40 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.276434 Jul 20 19:30:50.981726 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 199/392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:51.348329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-858067168", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "networks": [{"uuid": "9c307b5c-a0b2-4dc9-b558-9f63e318c26c"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:51.405093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] validate_networks() for [('9c307b5c-a0b2-4dc9-b558-9f63e318c26c', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:30:51.524272 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.524985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.531989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.532546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.533441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.533893 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.855942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:51.866887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3344cfaa-adf0-40c5-8230-f591a0ed1fa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.346524 Jul 20 19:30:51.868609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 200/393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:51.874150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.875137 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.882655 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.883214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.884062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.884566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.023100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:30:52.023528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:30:52.024001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:30:52.024414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:30:52.024828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:30:52.034183 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.035101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.035923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.036412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.058749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Getting quotas for project b1f129d1e4d4431c928dc63146543497. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:52.059472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Getting quotas for user 6eb501c4fd084c619501f565dc16277c and project b1f129d1e4d4431c928dc63146543497. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:52.070347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.072013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:30:52.075130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:30:52.080907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-70eb3a50-7427-4c1f-bc38-5bbcf1d8f9ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.211088 Jul 20 19:30:52.090587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 201/394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:52.090587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.090587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.090587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:52.095735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.096191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.097009 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.097448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.142123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-103aff6c-31b1-4e8e-87b9-21bcbe7db543 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797750 Jul 20 19:30:52.143131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 194/395] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:30:52.148657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.149312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.155874 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.156324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.157301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.157853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.184082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:52.479348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.499961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.501686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.502999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ff781707-2eec-4544-b62a-de7a1dea9370 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.420010 Jul 20 19:30:52.504014 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 202/396] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:52.508151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.522840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e7c14d46-51df-4a4e-b006-62e7f4ecb8b4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.378316 Jul 20 19:30:52.524392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 195/397] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:52.527782 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-67609157-86d6-4df9-b5af-3ff9ed4fe0b5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.528751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-67609157-86d6-4df9-b5af-3ff9ed4fe0b5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.588660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-67609157-86d6-4df9-b5af-3ff9ed4fe0b5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.596462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-67609157-86d6-4df9-b5af-3ff9ed4fe0b5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1213 microversion: 2.1 time: 0.091159 Jul 20 19:30:52.597325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 203/398] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:52.890693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.891215 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.898808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.899254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.900231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.900663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.038673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.046716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4c03feb5-5f33-4790-996f-a7a4cd83a2be tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.160198 Jul 20 19:30:53.047285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 196/399] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:53.098144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.098746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.105616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.106075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.106859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.107300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.245112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.252778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5e48c49a-ea45-4af5-a7dc-7cd11db18a52 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.158558 Jul 20 19:30:53.253382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 204/400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:53.522952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.523526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.530146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.530596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.531381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.531812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.544403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.545629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.558379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.559280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.560937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.561697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.737358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.746533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.748034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.749222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3ef53a45-e45b-4bff-a490-5cc856c89256 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.230502 Jul 20 19:30:53.749795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 197/401] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:53.754499 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.755100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.761756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.761950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.762313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.763084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.763516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.769507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-47182c22-7c1e-44cc-812e-66d162746405 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.228929 Jul 20 19:30:53.770088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 205/402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:53.827840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.835385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1ceb27b9-528d-4bf9-9bb1-71b122e80e1d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.084589 Jul 20 19:30:53.835950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 198/403] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:54.063784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.064394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.071565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.072030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.072778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.073250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.077295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:54.213204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.221075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9a750477-2ad3-4f60-99af-f3b45ecf7219 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.161191 Jul 20 19:30:54.221642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 206/404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:54.272050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.272639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.279031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.279505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.280276 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.280746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.409516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.418211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5a29dceb-d7bc-4025-9595-bf73418a9104 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.150102 Jul 20 19:30:54.418769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 199/405] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:54.769430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.770060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.776705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.777190 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.777966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.778407 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.786201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.786926 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.793374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.793815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.794570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.795004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.969050 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.977757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.979283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.980465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0c27295c-127c-4277-ae6d-d8c97568dd41 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.214961 Jul 20 19:30:54.981166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 207/406] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:54.986922 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.987542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.991578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.993943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.994446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.995297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.995778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.000043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-91103eda-4a38-4fc4-a70a-cf315757e44e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.217948 Jul 20 19:30:55.000610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 200/407] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:55.057236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.064681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8e08885b-dee4-4e52-8495-ec7e12be2858 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.082365 Jul 20 19:30:55.065430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 208/408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:55.238870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:55.239407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:55.246286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.246737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.247517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.247953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.379417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.388099 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3b536698-6ce2-4f76-aebf-580588abe28e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.153191 Jul 20 19:30:55.388654 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 201/409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:55.436218 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:55.436830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:55.442797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.444280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.445149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.445585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.575362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.582784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8bb182a0-0461-40a4-891a-5ffec3eccb23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.150537 Jul 20 19:30:55.583347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 209/410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:55.999399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.000034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.007269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.007709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.008470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.008927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.018029 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.018740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.026434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.026970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.028097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.028544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.215760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.218681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.223270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9d3a3e8b-3116-4627-a2b7-7b754c9dfcf0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.209070 Jul 20 19:30:56.223846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 210/411] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:56.227877 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.228959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.229570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.229671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.231034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-945d7750-6e6f-42a3-9b35-f804d85e31e0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.235668 Jul 20 19:30:56.231747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 202/412] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:56.235529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.236022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.236749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.237223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.299151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.307024 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ba8182ba-3677-4c11-ad76-9e58f9bbfd45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.081617 Jul 20 19:30:56.307589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 211/413] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:56.405206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.405973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.413496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.413949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.414735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.415173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.565905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.576505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8202aa6f-92f2-49fb-acd6-3e88587d6ed5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.174947 Jul 20 19:30:56.577203 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 203/414] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:56.600345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.601365 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.608447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.608447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.609177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.609684 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.746806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.754704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ab3a0fe4-7094-4be5-ab90-a1bd099949ac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.159064 Jul 20 19:30:56.755264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 212/415] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.240094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.240796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.247728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.248204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.249169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.249632 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.255017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.256832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.262911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.263357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.264156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.264587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.448062 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.455576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-edcd861c-2514-474b-b737-e5b06a63f7dd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.219700 Jul 20 19:30:57.456147 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 204/416] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.461085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.461698 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.467786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.468240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.469056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.469426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.469542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.478217 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.479755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.481001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1ba07581-20e6-4c03-8d13-f2b62bb54ff8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.234115 Jul 20 19:30:57.481770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 213/417] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:57.532634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.541208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c02e238c-c62e-473f-8710-0f90c5117338 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.084097 Jul 20 19:30:57.541775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 205/418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.593980 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.594589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.601346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.601795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.602548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.602979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.735593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.745441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d6631d06-3a68-4fc8-9bc9-ba0649b74f5a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.155108 Jul 20 19:30:57.746119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 214/419] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.771326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.771945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.778249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.778700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.779466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.780026 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.916941 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.924373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2398648c-c906-43ee-9563-2bcec1cd19b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.156862 Jul 20 19:30:57.924970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 206/420] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.192481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-e2863794-c9a2-4bb8-b390-02d6a732596c req-ab205d67-52fe-4b98-b85f-ae4109b870f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "name": "network-vif-plugged", "status": "completed", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:58.201850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-e2863794-c9a2-4bb8-b390-02d6a732596c req-ab205d67-52fe-4b98-b85f-ae4109b870f7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.202295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-e2863794-c9a2-4bb8-b390-02d6a732596c req-ab205d67-52fe-4b98-b85f-ae4109b870f7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.215842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-e2863794-c9a2-4bb8-b390-02d6a732596c req-ab205d67-52fe-4b98-b85f-ae4109b870f7 service nova] Creating event network-vif-plugged:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:30:58.220856 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-e2863794-c9a2-4bb8-b390-02d6a732596c req-ab205d67-52fe-4b98-b85f-ae4109b870f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Jul 20 19:30:58.221470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 215/421] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:58.472913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.473461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.480849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.481425 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.482396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.482959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.501288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.501993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.509584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.510033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.510806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.511244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.888521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.896818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1645f2b8-f9c3-4055-9074-95542125aed0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.427138 Jul 20 19:30:58.897408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 207/422] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.907422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.908143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.913265 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.916295 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.916742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.918163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.918615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.922146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.924414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.925753 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-15f5af60-d914-4161-9cab-7b802365754b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.428690 Jul 20 19:30:58.926587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 216/423] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:58.931693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.932295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.938843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.939450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.940439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.941004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.995439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.004065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3b48f14c-0914-4d8b-a918-59a69d6cbdeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.100429 Jul 20 19:30:59.004693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 208/424] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:59.010497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.011722 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.019193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.019643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.022230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.022811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.143825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.152394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9d227900-c77e-4495-8a81-ae826d2dbf6a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.224820 Jul 20 19:30:59.152989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 217/425] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:59.192017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.200619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a70e02dc-0eed-41e4-b55b-bc278b7132d9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.194705 Jul 20 19:30:59.201279 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 209/426] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:59.914187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.914888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.921621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.922080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.922857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.923303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.945424 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.946130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.952796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.953368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.954208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.954995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.112861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.121824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1af6e452-05c9-463b-8cd0-aeb41a98da6e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.212204 Jul 20 19:31:00.122518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 218/427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.127611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.128471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.135909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.136483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.137385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.138022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.150198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.162487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.164230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.165673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-15a7a831-5438-40d3-8c8a-4eb615a784db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.224489 Jul 20 19:31:00.166518 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 210/428] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:00.171393 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.171987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.178663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.179105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.179864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.180301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.204344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.213448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-37833e64-dc6c-4b9e-9558-78c8677547ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.089628 Jul 20 19:31:00.214151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 219/429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.218981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.219586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.226142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.226713 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.227550 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.227885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.362898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.371340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-dde8d75b-acad-4119-8b9d-278932d9bc00 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.203510 Jul 20 19:31:00.372023 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 211/430] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.392287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.400508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-08018bdd-75f1-4252-a59e-ed7434add27e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.185328 Jul 20 19:31:00.401105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 220/431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.139893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.140501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.147388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.147839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.148609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.149076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.153067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:01.184618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.185255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.192392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.193076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.193903 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.194809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.343221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.352769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-64bd15f8-a6d1-4131-863a-6f08c8a9395c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.216590 Jul 20 19:31:01.353921 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 212/432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.358904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.359746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.366005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.366529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.367382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.367887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.379760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.389128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.391065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.392626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7b2cc05f-3910-413f-9192-34a69346b146 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.211707 Jul 20 19:31:01.393637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 221/433] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:01.398886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.399588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.414421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.415117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.416364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.417089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.440211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.450974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fb90300e-eeaa-41d2-a285-e5f96adfc416 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.095090 Jul 20 19:31:01.451570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 213/434] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.462630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.463504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.469712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.470362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.471231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.471725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.614927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.624898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3b0cd5f1-2a76-41ca-8870-686b83506cad tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.229965 Jul 20 19:31:01.626333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 222/435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.643194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.651919 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-30e56461-dd36-45bf-a83f-d408e84aff23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.193751 Jul 20 19:31:01.652497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 214/436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.371432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.372053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.378757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.379218 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.379996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.380443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.395520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.412915 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.413994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.415949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.416770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.423524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.423974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.424752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.425227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.578889 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.587671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7572b2f1-0404-47a4-a8c5-4e5f5899f8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.220927 Jul 20 19:31:02.588255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 223/437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.594641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.596584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.601708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.608124 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.609142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.609400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.609536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.609974 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.618702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.620372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.621683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9a0abfc2-bf4f-4363-b9e4-9c448a017b9b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.213745 Jul 20 19:31:02.622668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 215/438] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:02.643383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.644205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.651689 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.652650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.653657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.654639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.684762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.692611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-00ae5aee-f52d-4678-938d-1d073388755f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.102489 Jul 20 19:31:02.701968 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 224/439] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.706779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.707410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.714747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.715208 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.716158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.716736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.867858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.877377 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-48f80f8a-21a6-4068-826a-84e45be0dda5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.237889 Jul 20 19:31:02.878157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 216/440] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:02.896090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.905059 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6a3dd80e-4145-4ac0-a1dc-5a2e4933d3ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.202528 Jul 20 19:31:02.905646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 225/441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:03.604479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.605262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.612024 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.612468 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.613372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.613812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.639685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.640299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.647357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.647823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.648608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.649084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.800901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.809306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ab677542-58fd-4fc2-bc1f-b2368e49ee90 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.208565 Jul 20 19:31:03.809899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 217/442] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:03.814586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.814985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.821852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.822286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.823069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.823510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.824718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.832623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.834172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.835702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-54db9613-fbb2-494b-a53a-5eeab79e7a8d tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.199836 Jul 20 19:31:03.836268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 226/443] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:03.885448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.893277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b216226c-cc42-44c3-b48c-acafb98cb5a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.082353 Jul 20 19:31:03.894001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 218/444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:03.895020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.895744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.902163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.902696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.903550 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.903993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.924191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.924583 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.931611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.932060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.932835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.933297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.120106 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:04.133066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d250b029-5bfb-488a-a39b-63861e66a96a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.241913 Jul 20 19:31:04.133906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 227/445] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:04.143168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:04.149128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9d30da78-0130-422b-aa26-61dfe1042204 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.229491 Jul 20 19:31:04.149819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 219/446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:04.826295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.826904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.833575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.834034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.835476 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.835912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.854004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.854713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.861246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.861702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.862506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.862946 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.042355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.051275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-bd87a482-7941-4dd6-8a82-60ab902463d2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.228612 Jul 20 19:31:05.051919 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 228/447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:05.052058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.057878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:05.058835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:05.063453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.065050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.065561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.066019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.066600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-241b4de0-26d3-4aa2-9a8b-39ef5740c62e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.216547 Jul 20 19:31:05.066815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.067168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 220/448] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:05.067270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.133458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.141840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-200062d4-64bb-4123-8166-f7891f443826 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.088832 Jul 20 19:31:05.142418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 229/449] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:05 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:05.149869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:05.150488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:05.156651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.157134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.157906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.158347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.167816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:05.168668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:05.180921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.181522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.182408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.183085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.367667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.375550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2e98b8e3-cc13-4cae-9a10-77748d849f48 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.229748 Jul 20 19:31:05.376373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 221/450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:05 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:05.394457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.402769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cbaf6fe4-1b02-4812-b29b-c8742cb2d87d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.238857 Jul 20 19:31:05.403333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 230/451] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:05 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.068299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.069531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.076022 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.076469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.077267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.077706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.085470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.086098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.092748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.093254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.094041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.094489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.285733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.290167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.294277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ebc63f18-9465-47bd-a694-fd6cfaa35ba6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.229796 Jul 20 19:31:06.294846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 222/452] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.298254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.299277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.299906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.300031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.301250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c32b2750-904b-4462-ad79-84d0f334902b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.219841 Jul 20 19:31:06.301969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 231/453] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:06.306684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.307126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.307883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.308315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.371191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.378509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1cd4ec7a-a23a-46e4-9644-04b90830ec45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.082736 Jul 20 19:31:06.379068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 223/454] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.393586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.394203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.400246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.400697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.401510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.401947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.419839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.420447 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.426578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.427188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.428671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.429356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.602849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.610187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.611382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d36892e8-6f4b-45fa-aea1-165852af03f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.221675 Jul 20 19:31:06.611960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 232/455] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.618541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5432e499-ebbb-4328-9104-6cec32a533eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.202459 Jul 20 19:31:06.619880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 224/456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:07.311565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.312341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.320161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.320623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.321604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.322034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.322504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.323114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.330664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.331112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.331960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.340811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.523607 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.527449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.531187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-80cd5739-5b84-4f30-ad37-3d701db051f0 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.223469 Jul 20 19:31:07.531764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 233/457] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:07.535941 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.536499 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.537134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.537597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.539053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2f55dd73-b9d3-4dca-852a-239905c21469 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.221096 Jul 20 19:31:07.539980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 225/458] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:07.543906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.544364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.545169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.545643 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.607717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.615164 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-09863b45-dbe2-40d0-acd4-c2492cc83a66 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1217 microversion: 2.1 time: 0.082442 Jul 20 19:31:07.615786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 234/459] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:07.628185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.628802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.635529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.635727 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.635981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.636175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.636783 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.637241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.642215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.642669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.643652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.644100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.836291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.846241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6c6d74ac-2605-47e6-bc5f-1229cf68dda3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.221808 Jul 20 19:31:07.846896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 226/460] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:07.847579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.856409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-265269c4-eb4a-4d70-8092-e65e780ef8c9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.225202 Jul 20 19:31:07.858001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 235/461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:08.547691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.548323 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.556032 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.556596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.557491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.557781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.558297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.558536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.564999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.565444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.566208 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.566640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.778487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.781603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.789429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.790212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e2655078-1702-4af7-9187-58fa20c287ed tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.245737 Jul 20 19:31:08.799383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 227/462] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:08.799780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.799780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-56b1c8a5-c64d-4e8d-8d93-dd7b6878b77b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.240190 Jul 20 19:31:08.799780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 236/463] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:08.807879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.808501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.814807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.815273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.816027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.816496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.863639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.864385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.871321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.871771 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.872543 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.873007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.878875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.882324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:08.887405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2bebb3ee-a224-48ce-a178-d282ed1ce4d5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1209 microversion: 2.1 time: 0.095705 Jul 20 19:31:08.888074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 228/464] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:08.892736 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.893378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.900428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.900818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.901664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.902104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.079137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.081492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.088767 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c3fb25da-cfd2-4bcc-b0e5-e5ff3eba5e68 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.199575 Jul 20 19:31:09.089286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 229/465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:09.094588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fc75ff2d-d7a3-41bc-a20c-d922c03c3b4b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.233307 Jul 20 19:31:09.096920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 237/466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:09.808428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:09.809581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:09.812302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:09.813336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:09.813461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:09.816849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.817624 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.818257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.818765 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.820159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.820748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.821620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.822396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.013136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.019672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.020505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f49328a6-ac55-4dda-b196-b51ee9c796ad tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.216809 Jul 20 19:31:10.021148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 230/467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:09 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:10.025978 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:10.026588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:10.032356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.032802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.033308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.033608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.034047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.034920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.036382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d834fde7-a57d-40f2-8497-f503ec3d98e8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.228178 Jul 20 19:31:10.037161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 238/468] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:09 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:10.097222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.106159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:10.106746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-83a530cc-0ccd-45da-845e-03fc0751270e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.084438 Jul 20 19:31:10.106870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:10.107504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 231/469] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:10 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:10.112351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:10.112907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.113039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:10.113426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.114262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.114705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.120088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.120563 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.121360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.121796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.308720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.315659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.316615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9b88bbd4-8001-4abe-8963-0c6ab94286f3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.214738 Jul 20 19:31:10.317308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 239/470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:10 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:10.323867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-81b07f99-dd65-4fc3-842d-dd0ef720191d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.215236 Jul 20 19:31:10.324422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 232/471] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:10 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:11.038318 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.038938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.045434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.045888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.046661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.047100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.049709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:11.056826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.057461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.063622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.064547 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.064895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.065351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.234890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.243396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f83a6d32-526a-41f3-a599-600db3871f73 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.208844 Jul 20 19:31:11.243979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 240/472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:11.248398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.249352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.255291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.255734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.256831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.256969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.257307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.265862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.267489 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.268653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1faba730-b022-407c-a9ce-51022c891bc8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.217010 Jul 20 19:31:11.269243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 233/473] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:11.320000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.327539 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a2d49fb7-0334-425a-82cf-093598c5cde9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.082569 Jul 20 19:31:11.328111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 241/474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:11.333603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.334208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.340157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.340570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.340794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.341060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.341820 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.342247 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.346831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.347274 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.348091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.348783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.533772 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.552684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f63c04dc-fe71-4677-8d9d-24217c7ecff2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.217878 Jul 20 19:31:11.552684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 234/475] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:11.564061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:11.589088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a950ac18-f11f-4cc0-82e9-699ea0894a23 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.251225 Jul 20 19:31:11.592786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 242/476] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:12.260546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.261351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.267951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.268402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.269235 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.269686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.287628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.288237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.294957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.295408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.296180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.296617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.470624 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.478409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-23875b7e-3a7c-47ba-9a3b-d381a35fd2ac tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.222365 Jul 20 19:31:12.478991 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 235/477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:12.482325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.483422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.484017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.490496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.491001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.491120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.491829 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.492258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.493195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.494633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-06a8bbce-4ab5-444b-9fab-801b0c971454 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.211031 Jul 20 19:31:12.495480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 243/478] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:12.554132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.562364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-117f50c6-3058-44b8-978e-7addb07731f0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.082410 Jul 20 19:31:12.562997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 236/479] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:12.574529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.575141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.581192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.581649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.582425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.582895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.607673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:12.608313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:12.614488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.614945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.615770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:12.616314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.774519 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.781984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-061ec181-01c3-4311-a36b-25d158b96c43 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.212058 Jul 20 19:31:12.782549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 244/480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:12.797724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.806676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-17266591-38d9-4c69-a8bf-6b941b247613 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.202453 Jul 20 19:31:12.807179 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 237/481] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:12 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:13.496055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.496902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.504136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.504746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.505678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.506290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.512828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.513505 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.521870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.522433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.523213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.525507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.742314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.750397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a50f491c-66b3-40b0-b4bf-fbb5b06a606f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.258678 Jul 20 19:31:13.760608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 245/482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:13.762160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.765743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.766383 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.772432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.772685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.773093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.774834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.775191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.775682 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.776562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a5bf7d39-60b9-4701-b1c7-9fe11c7b1514 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.268230 Jul 20 19:31:13.777763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 238/483] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:13.798610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.799224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.806373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.806838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.807668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.808104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.900724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.908590 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a6ea52c6-7de2-48f8-9378-18fad5d3ad04 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.146649 Jul 20 19:31:13.909280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 246/484] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:13.914757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.915529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.924045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.924510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.928621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.929316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.974354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.988006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0e362e8a-4de4-4141-887d-c7b5d67a68e7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.193063 Jul 20 19:31:13.989802 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 239/485] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:14.085772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:14.093811 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5ed29c32-d99d-4614-9fc9-f62c59a3a25a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.183404 Jul 20 19:31:14.094376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 247/486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:14.273998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-84501851-af65-425e-848d-68d54bd4d728 req-9483005d-8496-499c-87d6-6999310aaf04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "name": "network-vif-plugged", "status": "completed", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:14.282377 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-84501851-af65-425e-848d-68d54bd4d728 req-9483005d-8496-499c-87d6-6999310aaf04 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.282816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-84501851-af65-425e-848d-68d54bd4d728 req-9483005d-8496-499c-87d6-6999310aaf04 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.295759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-84501851-af65-425e-848d-68d54bd4d728 req-9483005d-8496-499c-87d6-6999310aaf04 service nova] Creating event network-vif-plugged:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:31:14.301140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-84501851-af65-425e-848d-68d54bd4d728 req-9483005d-8496-499c-87d6-6999310aaf04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jul 20 19:31:14.301745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 240/487] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:14.768698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:14.769351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:14.779561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.780229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.781048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.781490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.799042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:14.799958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:14.806458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.806911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.807700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.808139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.222997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.227924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.234834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-34d5963d-b99c-4747-a5c3-0b4f751aae0f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.469829 Jul 20 19:31:15.237587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.239738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.241029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a11bc394-557d-4c2b-aa7a-a5fecc9759bf tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.447254 Jul 20 19:31:15.241486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 241/488] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:14 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:15.246269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:15.247061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:15.248237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 248/489] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:14 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:15.253373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.253826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.254603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.255042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.256221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:15.256829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:15.264593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.265400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.266461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.266903 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.350692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.358568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6666a1b6-054d-4765-af04-cd725361fcc0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.116034 Jul 20 19:31:15.359168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 242/490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:15 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:15.364184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:15.365114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:15.371785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.372230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.373081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:15.373457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:15.455648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.463864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-51ba3220-5f02-4752-8730-862f4ab6a0d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.214505 Jul 20 19:31:15.464442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 249/491] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:15 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:15.524155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:15.532535 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8feaf979-1962-4026-bd66-568588c864ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.172364 Jul 20 19:31:15.533144 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 243/492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:15 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:16.255905 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.256467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.259196 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.259811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.263054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.263503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.264269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.264702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.266254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.266697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.267460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.267891 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.463563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.470232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.471053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0a6147c2-6207-4958-9227-29368380c2cd tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.219371 Jul 20 19:31:16.471624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 250/493] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:16.476122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.476723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.480634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:16.482059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.484304 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.485524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.485757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-61f1bb63-e219-43b2-b3e2-e3dce37cfb65 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.230666 Jul 20 19:31:16.485971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.486688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 244/494] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:16.486822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.487174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.492583 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.493363 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.499550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.500077 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.500969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.501481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.552123 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.560130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6826e09b-e0ff-46e2-ba50-e0c90726c95f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.087465 Jul 20 19:31:16.560710 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 251/495] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:16.569953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:16.569953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:16.572681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.573157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.573936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.574376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.692922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.701068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-afa29bbb-2e6b-4d28-a8a5-34733e702ce8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.212934 Jul 20 19:31:16.705303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 245/496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:16.736971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:16.745707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-32c7ea71-1127-480e-9289-7ff194c5e221 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.184013 Jul 20 19:31:16.746273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 252/497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:16 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:17.488807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.489511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.496357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.496800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.497589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.498029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.502231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:17.505208 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.505812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.514038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.514485 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.515264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.515698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.699583 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.707055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4659d66d-9d8f-4d1b-ad53-99e1751fc733 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.222060 Jul 20 19:31:17.707634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 246/498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:17.710875 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.714466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.715088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.719487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.721013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.721693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.722161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-69dfacfb-340e-4808-b0f9-a87baceedf70 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.221038 Jul 20 19:31:17.722320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.722715 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 253/499] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:17.723090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.723590 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.727346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.728921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.735301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.735776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.736548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.737013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.789688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.797603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-29b4598e-8f8d-45b1-bdd2-18ee47ff0af5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.088941 Jul 20 19:31:17.798194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 247/500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:17.802886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:17.803639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:17.810864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.811317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.812088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:17.812529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:17.928695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.937606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-63a3b64d-f281-4322-9691-aeaa0367ae30 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.213807 Jul 20 19:31:17.938184 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 254/501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:17.974022 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:17.982343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ffec976d-1938-4abc-aba0-3130c1863034 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1724 microversion: 2.1 time: 0.183194 Jul 20 19:31:17.982934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 248/502] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:17 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:18.723795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:18.724416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:18.731748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.732211 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.733134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.733601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.740823 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:18.741460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:18.748577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.749065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.749985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.750451 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.941811 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.949715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.950219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b7ea1f47-f1ef-4020-af66-53f33f366fd5 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1359 microversion: 2.1 time: 0.230282 Jul 20 19:31:18.950808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 255/503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:18 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:18.955613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:18.956223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:18.957728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.959280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:18.960434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aac6b4ba-6668-4154-a0ec-1877513f9f96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.223655 Jul 20 19:31:18.962186 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 249/504] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:18 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:18.962790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.963480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.964463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.964957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.966832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:18.967434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:18.973591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.974033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:18.974785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:18.975212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.041226 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.043857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:19.051703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9c3280ab-ef36-4160-b034-ad5803ed808d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.099578 Jul 20 19:31:19.063424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 256/505] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:18 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:19.071142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.072046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.079578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.080002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.080779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.081243 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.177963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.202880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f4bdb551-483d-4d4e-a09f-a3ea11ac9c9b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1501 microversion: 2.1 time: 0.239546 Jul 20 19:31:19.203631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 250/506] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:18 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:19.221721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "149636d0-0f97-48a4-bf77-031eafb087c1"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:19.223623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.230954 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.231401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.232221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.233657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.261016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.261860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] HTTP exception thrown: Cannot 'attach_volume' instance 0e030ad0-4549-4070-bf06-563e23b2dce5 while it is in vm_state rescued Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Request method failure captured: Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/os-volume_attachments HTTP/1.1 Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 74 Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdDbOfeA4XyluI-RwaV8StPT-ddRKYfJoa13j6uQSZWTPND3X5lEIe0ltqd6KfP5Fn3XxQ11acH5XPn0S9y8E91f7eh9WpJrAwNFzLqEZxqpfHK-rjRiOgdD9uWWSNOmuvlFgT6_5VFULdy56eD_Xg4otVlU1qvnf0-ovIJp2zDELU Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:31:19.263852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9c025843a2de49d48c39b40f2261d3bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 347106fdd7c94624ab9d40b51da78623 Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {"volumeAttachment": {"volumeId": "149636d0-0f97-48a4-bf77-031eafb087c1"}} Jul 20 19:31:19.265265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Cannot 'attach_volume' instance 0e030ad0-4549-4070-bf06-563e23b2dce5 while it is in vm_state rescued Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'server_id': '0e030ad0-4549-4070-bf06-563e23b2dce5', 'body': {'volumeAttachment': {'volumeId': '149636d0-0f97-48a4-bf77-031eafb087c1'}}} Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:31:19.266110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0e030ad0-4549-4070-bf06-563e23b2dce5 while it is in vm_state rescued Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:19.267291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0e030ad0-4549-4070-bf06-563e23b2dce5 while it is in vm_state rescued Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Returning 409 to user: Cannot 'attach_volume' instance 0e030ad0-4549-4070-bf06-563e23b2dce5 while it is in vm_state rescued {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-996dd647-8113-4356-8fde-e138491af92d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048860 Jul 20 19:31:19.268370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 251/507] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:31:19 2022] POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 19:31:19.275564 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-08c9beb1-82b5-4e3d-931a-d947db04d396 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1701 microversion: 2.1 time: 0.210026 Jul 20 19:31:19.276254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 257/508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1701 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:19.276808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:19.277427 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.284031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.284482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.286208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.286655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.292938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-121847a4-5fff-4962-806c-b5f56d9964d5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:19.298999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-121847a4-5fff-4962-806c-b5f56d9964d5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.299465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-121847a4-5fff-4962-806c-b5f56d9964d5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.324845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-121847a4-5fff-4962-806c-b5f56d9964d5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Going to try to start instance {{(pid=117948) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 19:31:19.376289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-121847a4-5fff-4962-806c-b5f56d9964d5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action" status: 202 len: 0 microversion: 2.1 time: 0.086875 Jul 20 19:31:19.377279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 258/509] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:31:19 2022] POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:31:19.377795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5384ac7b-f02a-4eac-a029-66f900baf801 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/action" status: 202 len: 0 microversion: 2.1 time: 0.105865 Jul 20 19:31:19.381819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 252/510] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:31:19 2022] POST /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:31:19.387126 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.387892 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.390077 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.390841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.394971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.395446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.396258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.396690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.399556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.400103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.400918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.401364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.598362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.602774 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:19.607361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0e0f8618-160d-4d5b-b880-936f888186ac tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.225713 Jul 20 19:31:19.608179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 259/511] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:19.611300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-345ff42b-35c7-491b-b7da-d69e2e0d7155 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.228292 Jul 20 19:31:19.611963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 253/512] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:19.966801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.967334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.973901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.974369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.975128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.975565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.979997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:19.980665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:19.987343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.987796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:19.988565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:19.989031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.177648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.182340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.186988 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1e1f6251-1c17-42f9-98ca-c225cfc30edc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1548 microversion: 2.1 time: 0.224185 Jul 20 19:31:20.199991 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 260/513] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:20.199991 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.200297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.200397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.200474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.200474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7f3f1a92-75cf-4979-b79c-33beb46ef28c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.220137 Jul 20 19:31:20.200474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 254/514] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:19 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:20.200697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.200697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.200831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.201314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.210575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.211815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.222095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.222473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.223285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.223681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.266692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.274509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d8b6d2f7-1087-4a65-aa00-a65d536bcbfb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.085870 Jul 20 19:31:20.275163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 261/515] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:20.361225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.368687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-928416dd-6a52-43df-901b-482a07f0a2b9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1548 microversion: 2.1 time: 0.166867 Jul 20 19:31:20.369284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 255/516] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:20.384490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.387987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.388759 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Searching by: {'deleted': False, 'project_id': '91e1220a765f41e88d4e3480b9a7a687'} {{(pid=117948) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 19:31:20.395419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.395873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.396706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.397173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.490956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.multi_cell_list [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117948) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 19:31:20.587862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-307ff7f9-c584-4e6b-a607-7cd09d6c3da7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207576 Jul 20 19:31:20.588468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 262/517] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:20.598596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.599206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.606124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.606568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.607325 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.607759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.624707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.625364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.631630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.632087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.632866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.633420 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.818802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.822257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.827693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4aef5235-a077-4036-a2c2-f1e74e08ac8d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.206668 Jul 20 19:31:20.828201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 263/518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:20.830138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4bac9e1f-5e7f-4214-8d16-cae3b3109623 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1548 microversion: 2.1 time: 0.235301 Jul 20 19:31:20.830884 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 256/519] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:20.832729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:20.833357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:20.840044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.840494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.841277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:20.841710 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:20.984669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:20.993505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6e8e8108-4600-438d-bcb8-3d86a5845d7e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.163546 Jul 20 19:31:20.994001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 264/520] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:20 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:21.223348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:21.224005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:21.231443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.231887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.232648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.233112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.292536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:21.293185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:21.299191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.299641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.300418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.300864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.365031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.373038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fac1ac77-6895-4f2b-a074-e1bda19de0ce tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.085253 Jul 20 19:31:21.373617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 265/521] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:21 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:21.388308 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.396172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.397710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.398888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-57ffa944-25ce-426b-9537-7d3eb3096ea4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.179723 Jul 20 19:31:21.399433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 257/522] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:21 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:21.845449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:21.846069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:21.852812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.853277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.854039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:21.854467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:21.988076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:21.996241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a85b21a3-a369-4888-80b0-29ca6bcecb41 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.154650 Jul 20 19:31:21.996816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 266/523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:21 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:22.011331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:22.011969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:22.017970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.018417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.019177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.019610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.148346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.156763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6975f518-8414-4b2e-a247-70c448527116 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.149565 Jul 20 19:31:22.157380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 258/524] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:22 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:22.390153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:22.390756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:22.396854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.397339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.398139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.398617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.417339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:22.417988 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:22.424616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.425111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.425882 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:22.426318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:22.465247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.472831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f1944edc-30ab-4d60-8831-b580bdaa14a7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.086469 Jul 20 19:31:22.473396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 267/525] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:22 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:22.562112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.570075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.572456 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:22.573640 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-924f812e-cd73-44f3-8225-443977e6a0e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.160601 Jul 20 19:31:22.574200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 259/526] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:22 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:23.013536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:23.014147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:23.021421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.021872 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.022644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.023081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.152814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.161135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5ccbdd01-0051-4c5c-8827-ce625002e5a3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.151401 Jul 20 19:31:23.161701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 268/527] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:23 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:23.174794 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:23.175402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:23.182189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.182626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.183387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.183815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.322226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.329869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6b34ea77-2534-428b-8c79-6849bcf1619c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.158867 Jul 20 19:31:23.330429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 260/528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:23 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:23.491222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:23.491849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:23.497946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.498405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.499174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.499611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.563786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.572697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0b29dbdf-860f-444c-9477-185e3bdbecbb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.085652 Jul 20 19:31:23.573505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 269/529] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:23 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:23.592131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:23.592748 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:23.599377 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.599835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.600645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:23.601065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:23.736401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.745001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.746508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:23.747716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ec7639fe-d6a3-4a7f-b270-39239ef22cd3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.159516 Jul 20 19:31:23.748226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 261/530] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:23 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:24.178701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:24.179292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.186466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.186917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.187688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.188127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.327091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.335053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-897dbde2-0a6d-47ae-ac7b-619fb20bde93 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.160277 Jul 20 19:31:24.335775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 270/531] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:24 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:24.348313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:24.349285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.356222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.356803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.357631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.358069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.362263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:24.476085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aed6b19-bc47-4da9-8f78-26f3087673b9"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:24.477856 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.484234 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.484824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.485901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.486479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.494795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.502827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aae05e21-7cd8-4393-9eeb-8cf59d087db1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.159662 Jul 20 19:31:24.503623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 262/532] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:24 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:24.590709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:24.591458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.598321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.599041 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.599637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.600081 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.666544 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.675381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8b33fa80-c803-410f-8b39-23596deccffe tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1265 microversion: 2.1 time: 0.089263 Jul 20 19:31:24.675953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 263/533] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:24 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:24.765793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:24.766780 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.772867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.773336 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.774905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.775511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.918506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.926821 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.928406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:24.929596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-12d602b3-92e8-4196-b746-47dd03a4852f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1744 microversion: 2.20 time: 0.167756 Jul 20 19:31:24.930493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 264/534] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:24 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:25.354597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:25.355277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:25.361734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.362246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.363248 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.363844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.500758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.510155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9b647edc-8f14-4a08-b70b-3292b2664aa5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.159671 Jul 20 19:31:25.510729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 265/535] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:25 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:25.519018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:25.519618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:25.528666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.529148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.529911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.530343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.661927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.670293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cc4bf562-84cd-4d88-997c-db09068fcc6a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.154765 Jul 20 19:31:25.670854 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 266/536] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:25 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:25.691411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:25.692605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:25.698716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.699158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.699916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.700372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.762634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:25.770259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-28de9d45-89ed-48ba-b758-003fe6f4fe0f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1273 microversion: 2.1 time: 0.082599 Jul 20 19:31:25.770820 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 267/537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:25 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:25.948147 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:25.948756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:25.954812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.955258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:25.956056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:25.956451 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.088104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.096029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.097567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.098715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-df0ffe4c-a4a9-4870-89ff-a88cc07b6e81 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.154973 Jul 20 19:31:26.099271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 268/538] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:25 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:26.527882 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:26.528487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:26.534849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.535549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.536308 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.536734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.671196 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.679166 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8b3fea75-4024-4f82-8612-a3f0f27599b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.155746 Jul 20 19:31:26.679754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 269/539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:26 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:26.686233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:26.686844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:26.693151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.693597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.694361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.695029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.827907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.835576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-95c733e3-cfb1-42f0-8c35-0973639fdb0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.152925 Jul 20 19:31:26.836270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 270/540] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:26 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:26.840648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:26.841311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:26.847173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.847643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.848409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:26.848847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:26.910791 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:26.918348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-faf30ed1-a3b3-4f0f-95a8-eb06a35afc6b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1273 microversion: 2.1 time: 0.081098 Jul 20 19:31:26.918964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 271/541] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:26 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:27.118844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:27.119448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:27.125532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.125986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.126757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.127193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.263039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.270887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.272371 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.273578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8405ae0e-2e25-4f42-89ef-7a1fde14a55f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.159230 Jul 20 19:31:27.274149 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 272/542] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:27 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:27.696082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:27.696736 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:27.703357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.703804 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.704571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.705040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.843070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:27.851138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e32f6e88-0175-4073-848e-44dd6a04b027 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.159036 Jul 20 19:31:27.851732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 273/543] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:27 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:27.856155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:27.856787 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:27.863376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.863956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.864729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:27.865199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:27.999857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.007290 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-180abac3-d27b-4b0f-ac16-4fdea05a1e8e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.154628 Jul 20 19:31:28.008626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 274/544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:27 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:28.012670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:28.013282 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:28.018891 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.019332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.020082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.020509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.083371 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.091838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fb98ef41-598e-464e-9cad-aa6db0850001 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1273 microversion: 2.1 time: 0.082532 Jul 20 19:31:28.092403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 275/545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:28 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:28.196914 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:28.293315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:28.294053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:28.330296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.330929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.336469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.341560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.409495 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-04ad8107-f6e1-4342-ab38-e52ab4715d91 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.936805 Jul 20 19:31:28.411260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 271/546] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:31:24 2022] POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments => generated 194 bytes in 3940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:31:28.684436 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.697847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.700589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:28.721616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8d42c847-eeb1-47f9-a61f-997d9e3bf26c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.431571 Jul 20 19:31:28.750744 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 276/547] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:28 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:28.876649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:28.877995 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:28.886551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.887338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:28.888274 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:28.888916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.026103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:29.026725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:29.034475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.035443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.036386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.037005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.255115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.271701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0691f1c0-61d1-4061-a4e7-998cec08607e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.406435 Jul 20 19:31:29.272466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 272/548] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:28 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:29.282049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:29.282985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:29.298341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.298969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.300018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.300536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.684313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.694404 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-626a89af-7b3f-487c-8904-550dd894895d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1271 microversion: 2.1 time: 0.417161 Jul 20 19:31:29.695356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 273/549] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:29 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:29.777887 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:29.778763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:29.806760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.809181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.811279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:29.812388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:29.839803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:29.864516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-00358557-a372-4b76-81e0-65b00fae71b6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.842350 Jul 20 19:31:29.865961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 277/550] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:29 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:30.136246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.147225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.152979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.155309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e9f9eeed-8979-4bda-9cc1-d1717ea535ea tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.403066 Jul 20 19:31:30.156681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 274/551] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:29 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:30.296678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:30.297967 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:30.318155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.318958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.320397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.325769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.514841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.528567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:30.536168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ecdcfebb-cd26-4f39-b9c2-d5b1a78e398a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.248658 Jul 20 19:31:30.536775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 278/552] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:30 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:30.718671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:30.718671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:30.718671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:30.724283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.724743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.725656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.726101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.893959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:30.895354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:30.903475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.904359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.905569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:30.906243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:30.918691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:30.931867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9c8115fc-976f-4cac-8fd7-6230eeeefafa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.223797 Jul 20 19:31:30.932484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 275/553] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:30 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:31.093628 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:31.104894 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c830b6bb-5d77-4344-9add-95c70dcc1be5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.214320 Jul 20 19:31:31.105487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 279/554] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:30 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:31.175403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:31.178564 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:31.186162 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.186589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.188648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.189294 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.380967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:31.395259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:31.396841 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:31.398071 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-93a8a38d-7a90-48d3-b99e-78e3fb9c05a7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.226889 Jul 20 19:31:31.399233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 276/555] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:31 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:31.558116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:31.558894 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:31.566084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:31.567859 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.568536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.569376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.569985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.806038 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:31.821085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a97077c9-e44a-4f76-8f6b-de485ccde049 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.265312 Jul 20 19:31:31.822255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 280/556] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:31 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:31.951477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:31.953845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:31.963718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.965022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:31.966048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:31.966496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.122348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:32.124143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:32.132624 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.133901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.135607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.136229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.191993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:32.201183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-241d7f86-3804-43b4-8bc7-b98f67bba2c0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.255467 Jul 20 19:31:32.212387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 277/557] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:31 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:32.324210 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:32.325145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:32.334327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.335047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.339921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.339921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.510194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'services' on Instance uuid 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:32.540617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:32.548847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-82fb3534-520a-4d61-be33-8788802a58ad tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1509 microversion: 2.1 time: 0.430302 Jul 20 19:31:32.549465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 281/558] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:32 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:32.567247 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:32.568685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:32.581389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.582291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.583350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.584152 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.740466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-68e2fa80-e196-4404-9ebd-4a8f0e6ed02c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d/os-volume_attachments/73519863-4c46-4e81-a479-617bf716f314" status: 202 len: 0 microversion: 2.1 time: 0.421467 Jul 20 19:31:32.755691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 278/559] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:31:32 2022] DELETE /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d/os-volume_attachments/73519863-4c46-4e81-a479-617bf716f314 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:31:32.839394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:32.840112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:32.868816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.869296 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:32.870095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:32.870531 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.161548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.174553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.176114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.182434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e52fe741-e81b-47e9-867d-39713602883c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.616142 Jul 20 19:31:33.183367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 282/560] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:32 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:33.223204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:33.226227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:33.242896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.243773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.244870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.247531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.277213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.287862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f2940379-f64b-46c9-8a06-7f6381adda71 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.452728 Jul 20 19:31:33.294418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 279/561] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:32 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:33.550224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.561579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9b360485-1573-4225-ba2b-8a317e85e61e tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.343560 Jul 20 19:31:33.564769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 283/562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:33 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:33.569707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:33.570884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:33.580355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.581075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.582065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.582654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.671138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-2df6483c-fa8d-4f22-ad80-364a27684fa7 req-34da51ae-ec2f-4b96-9ff5-2ba065306680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7a9601-831b-4e12-b7ec-09d6fd8c670e", "tag": "52963855-f3fe-4c5a-a944-71fa5b928567"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:33.689903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-2df6483c-fa8d-4f22-ad80-364a27684fa7 req-34da51ae-ec2f-4b96-9ff5-2ba065306680 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:33.691089 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-2df6483c-fa8d-4f22-ad80-364a27684fa7 req-34da51ae-ec2f-4b96-9ff5-2ba065306680 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:33.724837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-2df6483c-fa8d-4f22-ad80-364a27684fa7 req-34da51ae-ec2f-4b96-9ff5-2ba065306680 service nova] Creating event network-changed:52963855-f3fe-4c5a-a944-71fa5b928567 for instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e on hv-cinder-85054 Jul 20 19:31:33.738496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-2df6483c-fa8d-4f22-ad80-364a27684fa7 req-34da51ae-ec2f-4b96-9ff5-2ba065306680 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071217 Jul 20 19:31:33.740202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 284/563] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:33.796204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:33.807540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2f67c01c-478d-4b16-9de6-17f1a8ec0323 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1515 microversion: 2.1 time: 0.241849 Jul 20 19:31:33.808411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 280/564] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:33 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:34.207655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:34.208585 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:34.221350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.224769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.225782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.226322 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.311320 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:34.312700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:34.319343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.323314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.324313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.325136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.543646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.557968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.560457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.562496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-faa2a850-23df-4bef-96e3-d06851d49089 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.360672 Jul 20 19:31:34.564192 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 285/565] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:34 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:34.583991 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:34.585283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:34.600608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.609315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.611634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:34.612648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:34.621892 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.631981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c8637a62-76fb-41f5-8b17-7132617d049f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.325156 Jul 20 19:31:34.644629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 281/566] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:34 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:34.797730 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:34.806160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1dcbf9f7-5d41-4b71-bb22-3737a0436e39 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.228198 Jul 20 19:31:34.816320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 286/567] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:34 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:35.313226 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a40512ee-4c7e-4149-8184-e6ce4d076def tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: .version_select at 0x7f0e85c30790>, body: {"keypair": {"name": "tempest-keypair-664342980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSkm4G68lXJm47Ff1sktLUYAThpQo4+OSFdmB1Julii3VVoTiNSjrFwXXvhyA87C5SiMssPCeW1yWhKLXFKZWOukgiWTYzLt907zpfE/HD9Jv+K2v3aamYjTQJEPSLtmg=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:35.331055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-a40512ee-4c7e-4149-8184-e6ce4d076def tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:31:35.357745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-a40512ee-4c7e-4149-8184-e6ce4d076def tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for user 347106fdd7c94624ab9d40b51da78623 and project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:31:35.441939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a40512ee-4c7e-4149-8184-e6ce4d076def tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129394 Jul 20 19:31:35.459534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 282/568] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:31:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:35.588701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:35.589907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:35.605146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.609614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:35.610766 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.612242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:35.656221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:35.657436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:35.676916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.681729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:35.684201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:35.685155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:36.046107 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.069264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.081507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-87a25d4c-6d33-434b-a1f3-47f7ffd2705f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1710 microversion: 2.1 time: 0.429862 Jul 20 19:31:36.082363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 283/569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:35 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1710 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:36.089233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:36.090115 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:36.090630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.092344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.094104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f98a1d29-8218-437d-aaca-dd74bea45632 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.514008 Jul 20 19:31:36.102792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:36.111376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 287/570] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:35 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:36.112465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:36.113681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:36.114769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:36.423768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:36.434351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-59bca6d7-c913-4ff7-b92f-d4fa96958c96 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.350870 Jul 20 19:31:36.435057 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 284/571] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:36 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:37.105811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:37.106429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:37.128987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:37.130846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:37.133350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.134612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.136931 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.138109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.146644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.147091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.150085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.150708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.498856 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.502231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.511195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-788909c1-0fc7-4617-94f0-b6b8f2561af0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1714 microversion: 2.1 time: 0.411132 Jul 20 19:31:37.511424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.513765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.515799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-207b83af-f398-4861-a374-d1b9b9ca0da3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.390668 Jul 20 19:31:37.516849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 285/572] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:37 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:37.522484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 288/573] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:37 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1714 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:37.526052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:37.530157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:37.537695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.539858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.540915 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:37.541553 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:37.726021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:37.748296 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0a94b861-09cf-4ae3-aaac-0d3e9e999fa7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.227013 Jul 20 19:31:37.753431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 286/574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:37 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:37.921059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1744960986", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2deda7b4-dab0-4eb8-8cde-830d55ad6ecc"}], "security_groups": [{"name": "tempest-securitygroup--403762718"}], "key_name": "tempest-keypair-664342980", "user_data": "}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:38.536953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:38.538253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:38.545938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.546392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:38.547224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.547617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:38.722170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:38.725466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:38.744516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:38.746824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:38.748502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0f66c2e6-edf5-4476-993c-ea0bcfca4a04 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.216341 Jul 20 19:31:38.753236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 287/575] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:38 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:38.770000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:38.770896 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:38.784138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.786021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:38.786566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:38.787026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:38.966035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:38.974369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9cb9bbe5-072a-4390-b3e0-fd4c64072874 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.208439 Jul 20 19:31:38.975326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 288/576] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:38 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:39.771829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:39.772514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:39.788814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:39.790646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:39.791668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:39.792110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:39.974429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.988081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.989970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:39.991157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5e447c0e-e751-4a57-938b-c480dfc2b13a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.223451 Jul 20 19:31:39.991719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 289/577] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:39 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:40.006829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:40.008509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:40.015142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.015593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.016372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.016809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.170077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:40.177696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-07264901-2918-40e2-9348-d0d7d189e00d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.184089 Jul 20 19:31:40.178290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 290/578] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:39 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:40.332077 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] validate_networks() for [('2deda7b4-dab0-4eb8-8cde-830d55ad6ecc', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:31:40.873934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:31:40.874433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:31:40.874915 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:31:40.875521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:31:40.875948 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:31:40.885708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.887370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.887370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:40.887370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:40.907883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:31:40.914714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Getting quotas for user 347106fdd7c94624ab9d40b51da78623 and project 9c025843a2de49d48c39b40f2261d3bf. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:31:40.927607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:31:40.930106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:31:40.984043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6ada4466-223e-438d-b565-b00b2c4f1535 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.068363 Jul 20 19:31:40.984915 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 289/579] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:31:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 3070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:31:40.996350 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-17fd21a8-9c96-412c-ae54-c01c2ae919c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:40.998228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-17fd21a8-9c96-412c-ae54-c01c2ae919c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:41.011981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:41.012692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:41.019622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.020377 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.020861 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.021327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.079338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-17fd21a8-9c96-412c-ae54-c01c2ae919c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.090249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-17fd21a8-9c96-412c-ae54-c01c2ae919c8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1245 microversion: 2.1 time: 0.097693 Jul 20 19:31:41.103149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 291/580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:40 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:41.197707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:41.198525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:41.205159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.205975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.207035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.207652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.222893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.234803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.240997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.242408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ef4f70b4-5090-4278-b977-09fe69f0a619 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1739 microversion: 2.20 time: 0.235819 Jul 20 19:31:41.243297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 290/581] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:41 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:41.386056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.396824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e04a665f-de0e-4b49-b66d-a1ac1eedb878 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.204731 Jul 20 19:31:41.410608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 292/582] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:41 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:41.813444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:41.814058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:41.820233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.820694 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.821587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:41.822028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:41.955968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:41.966099 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8dc9fa28-8d79-4abe-af30-b09faf6fd4dc tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1594 microversion: 2.1 time: 0.156274 Jul 20 19:31:41.966907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 291/583] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:41 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:42.111873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:42.112695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:42.120054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.120677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.121612 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.122057 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.194332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.201936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ed8e1b5c-c31e-45a3-8a5b-460bfc7b1671 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1249 microversion: 2.1 time: 0.094157 Jul 20 19:31:42.202504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 293/584] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:42 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:42.261598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:42.262206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:42.268435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.268920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.269735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.270164 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.413022 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.419702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:42.420773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:42.424844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.426908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.428344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3fa77577-3c91-47f1-a543-1506407bdcc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.170633 Jul 20 19:31:42.429450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 292/585] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:42 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:42.448448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.449245 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.450521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:42.451174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:42.638503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:42.649728 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-377566a1-fa52-47b5-9769-407cd1e00427 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.235374 Jul 20 19:31:42.650588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 294/586] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:42 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:43.219563 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.222167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.230130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.230577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.231344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.232177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.308873 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.317302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c6a19191-23b9-448b-900c-891f7458638c tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1297 microversion: 2.1 time: 0.101320 Jul 20 19:31:43.317888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 293/587] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:43 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:43.448843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.450295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.453011 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:43.459755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.460230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.461382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.461895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.605896 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.606405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.616200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.619347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.620489 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.623568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.690872 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:31:43.765307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.778632 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.782687 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:43.784083 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-83a76110-7083-4b0d-be1e-c042f7d2afa1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.339829 Jul 20 19:31:43.785024 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 295/588] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:43 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:43.805585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.808722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.826809 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.829551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.831693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.832529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.886971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-04965ce6-0cd8-4527-8e72-472e0bc411aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 204 len: 0 microversion: 2.1 time: 0.285812 Jul 20 19:31:43.887562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 294/589] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:31:43 2022] DELETE /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:31:43.904754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-b2f6b9fa-d017-4ab5-b6cb-d0d7efe8ced8 req-9ff605dc-aa81-44e1-85c8-02d182225512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7a9601-831b-4e12-b7ec-09d6fd8c670e", "name": "network-vif-plugged", "status": "completed", "tag": "52963855-f3fe-4c5a-a944-71fa5b928567"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:43.926175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b2f6b9fa-d017-4ab5-b6cb-d0d7efe8ced8 req-9ff605dc-aa81-44e1-85c8-02d182225512 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.926619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b2f6b9fa-d017-4ab5-b6cb-d0d7efe8ced8 req-9ff605dc-aa81-44e1-85c8-02d182225512 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.936813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:43.948107 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-b2f6b9fa-d017-4ab5-b6cb-d0d7efe8ced8 req-9ff605dc-aa81-44e1-85c8-02d182225512 service nova] Creating event network-vif-plugged:52963855-f3fe-4c5a-a944-71fa5b928567 for instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e on hv-cinder-85054 Jul 20 19:31:43.958617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-b2f6b9fa-d017-4ab5-b6cb-d0d7efe8ced8 req-9ff605dc-aa81-44e1-85c8-02d182225512 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067371 Jul 20 19:31:43.959241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 295/590] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:43.967600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:43.968333 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:43.978113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.978585 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.979929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.983560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.256309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.266753 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-85630b84-3e61-4e84-9d90-122eb960b1d9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.479764 Jul 20 19:31:44.268415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 296/591] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:43 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:44.269800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.278090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-99e2208d-c4fd-42d7-a2a1-84362d1a8b6b req-8d444680-2533-4a98-8742-addc80dba9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:44.283666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4514a518-4ffc-478e-a779-1a67b1516ad9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1514 microversion: 2.1 time: 0.322997 Jul 20 19:31:44.286358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 296/592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:43 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:44.293173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-99e2208d-c4fd-42d7-a2a1-84362d1a8b6b req-8d444680-2533-4a98-8742-addc80dba9f7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.293619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-99e2208d-c4fd-42d7-a2a1-84362d1a8b6b req-8d444680-2533-4a98-8742-addc80dba9f7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.305868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-99e2208d-c4fd-42d7-a2a1-84362d1a8b6b req-8d444680-2533-4a98-8742-addc80dba9f7 service nova] Creating event network-changed:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:31:44.311665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-99e2208d-c4fd-42d7-a2a1-84362d1a8b6b req-8d444680-2533-4a98-8742-addc80dba9f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041407 Jul 20 19:31:44.312620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 297/593] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:44.336972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:44.337674 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:44.344177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.344946 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.346109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.346705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.423958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.434120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d9db13b1-9466-44a4-a7af-f236ea4674f1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1315 microversion: 2.1 time: 0.102304 Jul 20 19:31:44.434972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 297/594] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:44 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1315 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:44.807741 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:44.809389 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:44.819884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.820417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:44.821462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:44.821915 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.002400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.011754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.013419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.015286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2e033667-4718-499d-b7e6-e888aef9c967 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.214585 Jul 20 19:31:45.015886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 298/595] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:44 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:45.291796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:45.292495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.300430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.300838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.308360 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:45.308540 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.308909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.310015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.317906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.318622 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.319608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.320294 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.554707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.560159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.565390 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b30fc805-aec6-4161-a05b-67f4c72f9132 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.281571 Jul 20 19:31:45.566187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 298/596] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:45 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:45.568470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e3560771-bf0f-4d98-bcf1-cf7c9a06419b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1514 microversion: 2.1 time: 0.268094 Jul 20 19:31:45.574170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 299/597] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:45 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:45.574350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:45.574350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.574517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-337459103"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:45.574669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.580392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.580849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.580980 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.581705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.581825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.582176 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.582704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.583457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.666876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.674989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-546a95b2-d5bf-46fa-bd8f-88f2e667f3a4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1315 microversion: 2.1 time: 0.107304 Jul 20 19:31:45.675886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 299/598] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:45 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:45.750202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.network.security_group_api [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Adding security group 7a873f5b-f6c0-4459-89e4-8db8857352b6 to port 53beb0fe-5f2d-480b-8bef-611c76c92caf Jul 20 19:31:46.034634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.035609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.041988 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.042434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.043207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.043633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.243774 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.253178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.254800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.256172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4fa35bc6-61ad-438d-80c2-a28e9fa842f1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.225787 Jul 20 19:31:46.256827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 300/599] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:46.293542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-faf8e4f8-a8a6-45ec-89fe-631323c912c1 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action" status: 202 len: 0 microversion: 2.1 time: 0.723016 Jul 20 19:31:46.295638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 300/600] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:31:45 2022] POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:31:46.306298 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-9b200502-8272-4696-8b78-3aa8113d4f62 req-7b4c78a8-6072-4d74-8ec2-66a644febdfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:46.316395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.316980 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9b200502-8272-4696-8b78-3aa8113d4f62 req-7b4c78a8-6072-4d74-8ec2-66a644febdfe service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.316980 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9b200502-8272-4696-8b78-3aa8113d4f62 req-7b4c78a8-6072-4d74-8ec2-66a644febdfe service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.318073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.338333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-9b200502-8272-4696-8b78-3aa8113d4f62 req-7b4c78a8-6072-4d74-8ec2-66a644febdfe service nova] Creating event network-changed:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:31:46.339880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.340334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.341164 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.341601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.343430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-9b200502-8272-4696-8b78-3aa8113d4f62 req-7b4c78a8-6072-4d74-8ec2-66a644febdfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042383 Jul 20 19:31:46.344040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 301/601] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:31:46.529998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.538779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-413a77d6-292e-468e-becc-dd229ecaaa3e tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1640 microversion: 2.1 time: 0.237889 Jul 20 19:31:46.549710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 301/602] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1640 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:46.584734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.585662 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.589825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.591575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.593505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.593959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.594772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.595208 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.599136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.599636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.600340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.600785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.912440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.934145 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.942884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-da8d7881-7a2a-45bf-9145-84c71f3b58aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.363416 Jul 20 19:31:46.945957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b8be0e22-320c-4111-b140-282c6c290795 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1514 microversion: 2.1 time: 0.362959 Jul 20 19:31:46.953397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 302/603] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:46.958995 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.959246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 302/604] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1514 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:46.960059 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.967357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.968095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.969097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.969802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.075432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.085305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-50599408-b3dd-4c53-a9a0-1a46ab765964 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1303 microversion: 2.1 time: 0.130250 Jul 20 19:31:47.086595 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 303/605] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:47.276261 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:47.276937 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:47.287548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.288297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.289514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.289959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.630443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.639611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.641177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.642406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5de04840-7c17-4301-b9b8-80760c288646 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.370327 Jul 20 19:31:47.643502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 303/606] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:47 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:47.965275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:47.967184 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:47.967372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:47.968073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:47.981829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.982066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.982617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.982803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.983829 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.984196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.984699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.985199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.138616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.152501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c54d336f-0776-4d1f-8d26-64072b6a3910 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1472 microversion: 2.1 time: 0.188810 Jul 20 19:31:48.153138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 304/607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:47 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:48.158098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-9c5e9859-f62a-4ff2-a174-00d91da5c1e3 req-f9ee273c-0f3c-4015-b691-007204d30e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac8e4a2-4d14-4122-a963-6b8db3d39f3d", "name": "network-vif-deleted", "tag": "b89d5bd5-4a69-49c7-ac4b-30e7fb240a41"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:48.167242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9c5e9859-f62a-4ff2-a174-00d91da5c1e3 req-f9ee273c-0f3c-4015-b691-007204d30e8e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.171216 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9c5e9859-f62a-4ff2-a174-00d91da5c1e3 req-f9ee273c-0f3c-4015-b691-007204d30e8e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.181434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-9c5e9859-f62a-4ff2-a174-00d91da5c1e3 req-f9ee273c-0f3c-4015-b691-007204d30e8e service nova] Creating event network-vif-deleted:b89d5bd5-4a69-49c7-ac4b-30e7fb240a41 for instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d on hv-cinder-85054 Jul 20 19:31:48.186759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-9c5e9859-f62a-4ff2-a174-00d91da5c1e3 req-f9ee273c-0f3c-4015-b691-007204d30e8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 Jul 20 19:31:48.190270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 305/608] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:48.196634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:48.196906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:48.205763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.206724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.207904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.208576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.241544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.249338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0ad44f48-ed56-4d34-b29c-aa1c390cffa5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.292978 Jul 20 19:31:48.249916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 304/609] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:47 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:48.263773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-ed6da7a8-39c7-4a24-a676-4824b6638660 req-59f9beb4-f8b8-4c8e-9889-ccdb5f0597d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "name": "network-vif-unplugged", "status": "completed", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:48.272292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-ed6da7a8-39c7-4a24-a676-4824b6638660 req-59f9beb4-f8b8-4c8e-9889-ccdb5f0597d3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.272740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-ed6da7a8-39c7-4a24-a676-4824b6638660 req-59f9beb4-f8b8-4c8e-9889-ccdb5f0597d3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.284717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-ed6da7a8-39c7-4a24-a676-4824b6638660 req-59f9beb4-f8b8-4c8e-9889-ccdb5f0597d3 service nova] Creating event network-vif-unplugged:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:31:48.290322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-ed6da7a8-39c7-4a24-a676-4824b6638660 req-59f9beb4-f8b8-4c8e-9889-ccdb5f0597d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030111 Jul 20 19:31:48.290938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 305/610] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:48.357052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.365217 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ea5e7589-9153-49c2-a900-4bd86ac7f8d7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.173755 Jul 20 19:31:48.365776 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 306/611] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:48 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:48.662638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:48.663337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:48.669711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.670182 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.670943 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.671383 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.810975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.819538 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.822222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.823591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c6afe8ed-f9e1-4542-ae21-cbc6c534bd0e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.165573 Jul 20 19:31:48.824154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 306/612] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:48 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:49.170938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.171547 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.177815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.178267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.179030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.180373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.245503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.253070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-99b4e460-1e24-45c4-b1eb-cd3081012dd1 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1472 microversion: 2.1 time: 0.086252 Jul 20 19:31:49.253639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 307/613] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:49.266591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.267254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.274856 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.275309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.276091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.276572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.382520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.383222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.390307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.390756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.391535 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.391965 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.412275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.415275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:49.424451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-bfff7816-6634-49db-a0ac-e64b1255dd12 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.161355 Jul 20 19:31:49.425434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 307/614] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:49.533925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.542590 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3dc22627-8a8a-40ea-aefe-c48eac8f6182 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.164187 Jul 20 19:31:49.543167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 308/615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:49.842838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.843449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.849689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.850148 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.850932 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.851601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.983958 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.992698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.994391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.995713 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-891ec60c-f9d0-4245-982c-f4c1ed998bf1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1721 microversion: 2.20 time: 0.156806 Jul 20 19:31:49.996377 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 308/616] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:50.269452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.269979 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.276731 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.277210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.277988 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.278423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.357895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:50.368677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bfe3a1f5-2210-481f-af5a-939d5e9b099a tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1304 microversion: 2.1 time: 0.103255 Jul 20 19:31:50.369291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 309/617] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:50 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:50.443209 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.444308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.451633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.452176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.453069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.453578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.559367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.559980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.567499 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.567944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.569117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.569315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.896840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:50.922563 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:51.031274 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.041881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e41e6588-f580-4915-a365-3e874bdef9f5 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.602752 Jul 20 19:31:51.042508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.042661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 309/618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:50 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:51.048015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:51.049136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.050734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7dd5e666-dc49-4516-86b7-1000ac4e19fa tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.495336 Jul 20 19:31:51.051667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 310/619] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:50 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:51.057210 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.057914 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.058853 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.059467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.084450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:51.298377 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.306616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.308239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.309472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1b31afa7-4d72-479c-89c4-3b95343273dc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1724 microversion: 2.20 time: 0.265767 Jul 20 19:31:51.310071 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 310/620] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:51 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:51.328265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ce8777-a0ce-4f53-8cfa-fbce5916d5ab"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:51.329826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.337134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.337584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.338752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.339388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.389423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:51.389970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.397897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.399504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.400310 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.400751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.461673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.462962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.463978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'fault' on Instance uuid 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:51.548245 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.560213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-76c71c22-5b94-4af9-80d5-a3ed376e67df tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1309 microversion: 2.1 time: 0.177779 Jul 20 19:31:51.560625 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 311/621] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:51 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:51.586141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-3de2268b-fc20-411d-9c93-7ec4b60a2075 req-abad4685-c5cf-46cf-8004-4fe1af5443bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:51.589361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:51.608612 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3de2268b-fc20-411d-9c93-7ec4b60a2075 req-abad4685-c5cf-46cf-8004-4fe1af5443bb service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.609874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3de2268b-fc20-411d-9c93-7ec4b60a2075 req-abad4685-c5cf-46cf-8004-4fe1af5443bb service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.629092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-3de2268b-fc20-411d-9c93-7ec4b60a2075 req-abad4685-c5cf-46cf-8004-4fe1af5443bb service nova] Creating event network-changed:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:31:51.642517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-3de2268b-fc20-411d-9c93-7ec4b60a2075 req-abad4685-c5cf-46cf-8004-4fe1af5443bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058938 Jul 20 19:31:51.643942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 312/622] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:51.790920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-07e36a6e-c32c-43d0-b70e-2e304424eb86 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.466690 Jul 20 19:31:51.796378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 311/623] 10.222.0.79 () {62 vars in 1363 bytes} [Wed Jul 20 19:31:51 2022] POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 188 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:31:51.915439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:51.916082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.922287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.922750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.923497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.923926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.018843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4786e067-ffe7-4915-9f67-903c7d8ee28b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/action" status: 202 len: 0 microversion: 2.20 time: 0.108470 Jul 20 19:31:52.019466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 313/624] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 19:31:51 2022] POST /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:31:52.028123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.028918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.035244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.035951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.036733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.037190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.060051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.060951 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.069131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.069585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.070484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.071023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.258788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.266231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.271321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.273835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.275036 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-00229401-ab8f-45c4-8ce3-ab0954bf77dd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1313 microversion: 2.1 time: 0.219338 Jul 20 19:31:52.275656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-73305a81-5391-4a9d-baf6-cd00deb13a5b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1810 microversion: 2.20 time: 0.251819 Jul 20 19:31:52.276123 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 314/625] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:52.284244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.284868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.287299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 312/626] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1810 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:52.292969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.293648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.294439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.294879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.438178 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.446542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-56439f06-7416-4f81-808f-5dd3e0cce0f7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.169175 Jul 20 19:31:52.447231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 315/627] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:52.578233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.579376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.586271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.587036 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.587871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.588311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.622520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.622977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.623438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'fault' on Instance uuid 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:52.668561 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.676232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a39906e8-73a4-48ea-b097-55d14920352b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1309 microversion: 2.1 time: 0.101827 Jul 20 19:31:52.676815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 313/628] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:53.293077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.293669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.295415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.296047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.300546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.301020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.301786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.302167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.302295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.302623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.303399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.303838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.506070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.509661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.515828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.517360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.518813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bbcba017-0135-4bc0-91ed-4bee3f8c26c5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1750 microversion: 2.20 time: 0.227340 Jul 20 19:31:53.519193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3f5cfa4e-8c93-40a4-9806-a50bd032b0a8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1498 microversion: 2.1 time: 0.230545 Jul 20 19:31:53.519785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 316/629] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:53.521541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 314/630] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:53.526091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.526818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.533350 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.533803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.534574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.535011 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.668414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.676458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-99c5d873-45dd-4ff6-8121-55bb5295d1ce tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.155317 Jul 20 19:31:53.677069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 317/631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:53.693798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.694494 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.702860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.703131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.704590 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.705488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.742478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.743280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.744095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'fault' on Instance uuid 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:53.791324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.798775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cff3ec69-db37-43c8-8fd0-3dde70942325 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 200 len: 1309 microversion: 2.1 time: 0.108830 Jul 20 19:31:53.799355 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 315/632] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:54.430745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.431307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.437806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.438482 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.439454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.440047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.508963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:31:54.538917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.539955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.550537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.553520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.557586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.558582 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.652818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1db4c54d-01f5-4f94-8b79-39ab412e4aae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 204 len: 0 microversion: 2.1 time: 0.228142 Jul 20 19:31:54.653565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 318/633] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:31:54 2022] DELETE /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:31:54.663398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.664534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.675382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.676035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.676826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.677416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.902359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.913083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.916055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.917320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8fab18fa-3fd1-4c28-b7d1-9cb82474dd61 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.382749 Jul 20 19:31:54.929859 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 316/634] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:31:54.932266 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.937331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.938234 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.940157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-100b5e55-3098-42a2-8ee1-8fb90719991a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.281894 Jul 20 19:31:54.941256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 319/635] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:54.943894 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.945955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.946111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.946668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.946788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.947464 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.947907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.953801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.954542 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.955770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.956410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.975177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] HTTP exception thrown: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Request method failure captured: Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d HTTP/1.1 Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FeXYouUNqcsNUJ6uPXHESQjK2XtzgLEM6Hvlipu_Fk7fy50GhORrtxPxXrfRH5JUmWuGjhSC4Ee9tIINRN8R5FctAeEhrUFEsQUrfjPT4FGXISIairZjl9TOZiR-ReMTLRXO2mAF5tYATpw9YTOUEtBp864m0mlsT_7YIin1wQmeKE Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 2aa8c8dd804b46ca8996788a32b8383e Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:31:54.982267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2aa8c8dd804b46ca8996788a32b8383e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 2aa8c8dd804b46ca8996788a32b8383e Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesSnapshotTestJSON-335840475-project Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: e73da7d7237d4c9cb11c60a84e4dccd8 Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesSnapshotTestJSON-335840475-project Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. Jul 20 19:31:54.983629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '2ac8e4a2-4d14-4122-a963-6b8db3d39f3d'} Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:31:54.984336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. Jul 20 19:31:54.985596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:31:54.988027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Returning 404 to user: Instance 2ac8e4a2-4d14-4122-a963-6b8db3d39f3d could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:31:54.988970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-af0dfea5-05c1-495b-89b6-51aba932cb34 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d" status: 404 len: 111 microversion: 2.1 time: 0.046729 Jul 20 19:31:54.989700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 320/636] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/2ac8e4a2-4d14-4122-a963-6b8db3d39f3d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:31:55.097154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:55.106037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d773f055-e5c8-4eb5-8d01-1d6be18739b2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.174155 Jul 20 19:31:55.106686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 317/637] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:55.941673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:55.942293 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:55.948910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.949358 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.950128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.950566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.959409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:55.959959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:55.966733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.967129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.967899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.968363 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.158717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.169403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.171005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.172181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e025e6e5-7c5b-472b-8136-5d867e717a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.234477 Jul 20 19:31:56.172784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 321/638] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:55 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:56.173853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.182585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:56.183718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:56.184405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3d0148d4-8956-4685-98fb-8a0c273c65e8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.228857 Jul 20 19:31:56.185601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 318/639] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:55 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:56.199093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.199545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.200331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.200769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.337363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:56.339690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:56.346378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-62c1924b-01f9-4221-8110-49b53a557213 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.172320 Jul 20 19:31:56.346948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 322/640] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:56 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:57.190871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:57.191480 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:57.198867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.199438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.200339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.200789 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.202080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:57.202696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:57.213098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.213582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.214228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.214671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.391189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.400155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.401684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.402840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d40c8df5-e82c-4aed-9e56-6d11755367cc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.216113 Jul 20 19:31:57.403399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 319/641] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:57 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:57.408120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:57.408732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:57.414661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.415609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.416096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.416931 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:57.417382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:57.422881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-28e27c2d-9484-434f-a605-93d899af18e1 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.224888 Jul 20 19:31:57.423458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 323/642] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:57 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:57.571843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.579485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-493fee46-3370-4bda-a149-942ce8ad8750 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.175055 Jul 20 19:31:57.580054 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 320/643] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:57 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:58.421018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:58.421635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:58.428184 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.428636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.430078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.430677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.439411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:58.440015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:58.446899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.447339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.448107 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.448543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.632900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.641544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.643048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.644221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-08ddc8be-73a7-4fbf-9a13-9bd3772b0b9a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.227130 Jul 20 19:31:58.644868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 324/644] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:58 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:31:58.645131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.652459 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:58.653179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:58.653570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b03f3c99-eff0-4fa6-88e4-c03a89cb3b55 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.217887 Jul 20 19:31:58.654134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 321/645] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:58 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:58.659747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.660199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.661288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.661727 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.793712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.801159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f52eda88-8fe7-4e21-80eb-805816a44792 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.152950 Jul 20 19:31:58.801731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 325/646] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:58 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:59.667568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:59.668177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:59.671039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:59.671699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:59.674909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.675356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.676126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.676560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.678410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.678874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.680160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.680603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.089733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.093762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.098230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.099755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.101560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f322d311-8e6a-424a-9802-6e69f774a550 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.438391 Jul 20 19:32:00.102033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d34f44ff-b219-4c71-aa5b-2c9b05b2e06b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.435139 Jul 20 19:32:00.102191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 322/647] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:31:59 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:00.102681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 326/648] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:59 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:00.109575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:00.110411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:00.116385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.117692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.118520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.118953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.248080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.255451 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3e2394b7-53d8-4aa3-ac88-cd558e0bfe8b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.149430 Jul 20 19:32:00.255941 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 323/649] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:00 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:01.120342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:01.121090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:01.121513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:01.122156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:01.127997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.128442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.129317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.129820 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.131342 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.131828 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.133955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.134416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.379290 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.380992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.389153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-acf4ebe2-c13a-4c2f-805a-f40990570fb2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1504 microversion: 2.1 time: 0.273694 Jul 20 19:32:01.398896 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 327/650] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:01 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:01.403358 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.405098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.405759 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:01.406624 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b880db42-e2da-426e-91f6-a38d6d93369c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1752 microversion: 2.20 time: 0.290909 Jul 20 19:32:01.406979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:01.407399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 324/651] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:01 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1752 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:01.417015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.417713 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.418902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.419749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.610736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.620388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1334fb79-b875-47d6-9b45-dd739c09f9d3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.220173 Jul 20 19:32:01.621273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 328/652] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:01 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:01.926385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-9c256b05-e080-4d08-ac8c-76ffc4f245de req-c0b04adf-9726-44fc-8bea-a10cbadea678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7a9601-831b-4e12-b7ec-09d6fd8c670e", "name": "network-vif-deleted", "tag": "52963855-f3fe-4c5a-a944-71fa5b928567"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:01.934483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9c256b05-e080-4d08-ac8c-76ffc4f245de req-c0b04adf-9726-44fc-8bea-a10cbadea678 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.934919 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9c256b05-e080-4d08-ac8c-76ffc4f245de req-c0b04adf-9726-44fc-8bea-a10cbadea678 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.945430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-9c256b05-e080-4d08-ac8c-76ffc4f245de req-c0b04adf-9726-44fc-8bea-a10cbadea678 service nova] Creating event network-vif-deleted:52963855-f3fe-4c5a-a944-71fa5b928567 for instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e on hv-cinder-85054 Jul 20 19:32:01.950314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-9c256b05-e080-4d08-ac8c-76ffc4f245de req-c0b04adf-9726-44fc-8bea-a10cbadea678 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027683 Jul 20 19:32:01.950879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 325/653] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:02.406509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:02.407124 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:02.414453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.414909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.415691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.416162 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.427983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:02.428683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:02.439850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.440495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.441280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.441713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.481398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.489092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6b3002a3-9ffb-4882-b27e-7e601a3d3aa8 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1462 microversion: 2.1 time: 0.086387 Jul 20 19:32:02.491149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 329/654] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:02 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:02.580649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.589020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.590509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.591646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cf3e856c-5f4f-495f-837e-c3102e3335e6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.168442 Jul 20 19:32:02.592196 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 326/655] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:02 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:02.638493 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:02.639095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:02.645190 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.645636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.646396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.646825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.784792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.794949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4b4dc0e2-1ec4-4f51-8043-c0e210754646 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.160381 Jul 20 19:32:02.795742 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 330/656] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:02 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:03.506847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.508005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.514589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.515036 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.515799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.516237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.520347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:03.579907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.588111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4e2681ed-11b1-4bba-8af9-3e75e900edae tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1462 microversion: 2.1 time: 0.085128 Jul 20 19:32:03.588682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 327/657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:03.610117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.610722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.617393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.617945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.618712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.619144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.753678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.762926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.764388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.765591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-88191ef2-c883-42cc-970f-8eedd2ea5da6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.159557 Jul 20 19:32:03.766362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 331/658] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:03.812152 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.812758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.819342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.820260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.821300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.821738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.954334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:03.962084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-72664b8d-2856-4a83-af7a-a126dc99f375 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.154135 Jul 20 19:32:03.962703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 328/659] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:04.606004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:04.606618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:04.612722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.613432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.613961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.614399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.679282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.686932 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b0218006-10bd-48b1-b2f4-f9172c2e5a40 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1462 microversion: 2.1 time: 0.084754 Jul 20 19:32:04.687511 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 332/660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:04 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:04.784849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:04.785754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:04.793091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.793595 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.794361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.794799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.928420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.937052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.938562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.939710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2701451a-4107-49cd-ad81-e7a67631bf7b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.158891 Jul 20 19:32:04.940271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 329/661] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:04 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:04.979856 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:04.981056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:04.997129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:04.997901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.000044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.000523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.252391 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:05.260748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-46051d3d-8dc6-476e-8d1b-946998f41361 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.285690 Jul 20 19:32:05.271416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 333/662] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:04 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:05.703537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:05.704123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:05.710272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.710813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.711592 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.712030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.745132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.745586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.746046 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lazy-loading 'fault' on Instance uuid 7d7a9601-831b-4e12-b7ec-09d6fd8c670e {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:32:05.809591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:05.818642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2ac91fde-315b-4fe2-87a6-6890587a7ea7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 200 len: 1303 microversion: 2.1 time: 0.118900 Jul 20 19:32:05.819985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 330/663] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:05 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:05.958867 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:05.959490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:05.967338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.968232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.969237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.969952 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.998182 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-903583752", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "networks": [{"uuid": "6e06d9a4-c3cc-4d57-9431-dcfeac509b05"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:06.056397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] validate_networks() for [('6e06d9a4-c3cc-4d57-9431-dcfeac509b05', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:32:06.218315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.228484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.230032 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.231192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-72365bce-4118-4f5e-b459-9291743a52fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.276707 Jul 20 19:32:06.231764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 334/664] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:05 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:06.280040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.280660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:06.296040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.296699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.297720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.298292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.632423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.641891 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0f92d74d-fe3f-4c8c-af8e-038aaa295cac tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.365970 Jul 20 19:32:06.652648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 335/665] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:06.781607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:32:06.782435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:32:06.783332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:32:06.784348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:32:06.785389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:32:06.802423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.803160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.805862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.806460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.832459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Getting quotas for project 2aa8c8dd804b46ca8996788a32b8383e. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:32:06.839372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.839542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Getting quotas for user e73da7d7237d4c9cb11c60a84e4dccd8 and project 2aa8c8dd804b46ca8996788a32b8383e. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:32:06.839994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: 7d7a9601-831b-4e12-b7ec-09d6fd8c670e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:06.856560 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.856797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:32:06.857080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.857894 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.858961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.859996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:32:06.879796 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] HTTP exception thrown: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Request method failure captured: Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e HTTP/1.1 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FfpyvUBKERxeF1HVdeHJOjJMZQ0AxK8hB5XD8aPxiq3T9yuWZnpcBrUSxFpgwucZBReaHT9tfiGZsJQ2Kc5na40_9q-y1gqNxvUKZHTFKRQJgztbxm1NGif0Aykc7jg0Wr1JdPj2--s_rQmgofc6Jbvw3FVZilI25zPgsw1gQH2StE Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: b1f129d1e4d4431c928dc63146543497 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:32:06.882075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f129d1e4d4431c928dc63146543497", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: b1f129d1e4d4431c928dc63146543497 Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesActionsTest-1272599196-project Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 6eb501c4fd084c619501f565dc16277c Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesActionsTest-1272599196-project Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. Jul 20 19:32:06.883570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '7d7a9601-831b-4e12-b7ec-09d6fd8c670e'} Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:32:06.884369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. Jul 20 19:32:06.885665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:32:06.886747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Returning 404 to user: Instance 7d7a9601-831b-4e12-b7ec-09d6fd8c670e could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:32:06.886747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e843a7c4-729a-4620-a7a0-aa3b943e6509 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e" status: 404 len: 111 microversion: 2.1 time: 0.050654 Jul 20 19:32:06.889925 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 336/666] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/7d7a9601-831b-4e12-b7ec-09d6fd8c670e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:32:06.936871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-88964fec-d1bd-4c22-8ceb-c4a53f0a9c4e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942414 Jul 20 19:32:06.945591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 331/667] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:32:06.955109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c2283eaa-9940-4f89-8761-0ce6d8d94e8b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.955666 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c2283eaa-9940-4f89-8761-0ce6d8d94e8b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:07.021156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c2283eaa-9940-4f89-8761-0ce6d8d94e8b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.027485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-54be3755-de65-413d-b81e-88b381c51b61 req-709d0065-2f77-48f8-aecd-8dd1e625330a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "name": "network-vif-plugged", "status": "completed", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:07.030084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c2283eaa-9940-4f89-8761-0ce6d8d94e8b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1218 microversion: 2.1 time: 0.078850 Jul 20 19:32:07.032304 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 337/668] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:07.053271 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1601537193", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "networks": [{"uuid": "9c307b5c-a0b2-4dc9-b558-9f63e318c26c"}]}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:07.053953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-54be3755-de65-413d-b81e-88b381c51b61 req-709d0065-2f77-48f8-aecd-8dd1e625330a service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.054403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-54be3755-de65-413d-b81e-88b381c51b61 req-709d0065-2f77-48f8-aecd-8dd1e625330a service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.079155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-54be3755-de65-413d-b81e-88b381c51b61 req-709d0065-2f77-48f8-aecd-8dd1e625330a service nova] Creating event network-vif-plugged:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:32:07.089155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-54be3755-de65-413d-b81e-88b381c51b61 req-709d0065-2f77-48f8-aecd-8dd1e625330a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067145 Jul 20 19:32:07.090015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 332/669] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:07.122305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] validate_networks() for [('9c307b5c-a0b2-4dc9-b558-9f63e318c26c', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:32:07.251622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:07.252623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:07.262010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.263124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.265354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.266227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.629551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.645441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.647009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.648569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4de2d42a-a08c-43bf-b453-ff57a628e6aa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.401651 Jul 20 19:32:07.665712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 333/670] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:07 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:07.671755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:07.672743 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:07.680806 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.681475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.682420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.683009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.918767 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:32:07.919203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:32:07.919678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:32:07.920385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:32:07.920989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:32:07.925641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:07.947040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.948672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.949763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.954583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.963066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.972627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4a0a1147-7275-4166-9c7c-a6b672385407 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.305428 Jul 20 19:32:07.978994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 334/671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:07 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:07.997524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Getting quotas for project b1f129d1e4d4431c928dc63146543497. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:32:08.007854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Getting quotas for user 6eb501c4fd084c619501f565dc16277c and project b1f129d1e4d4431c928dc63146543497. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:32:08.021368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:32:08.024345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:32:08.049828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.050647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:08.059254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.061580 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.062693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.073743 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.082801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6edcdd08-6b9d-4498-b2d7-b6ea65063f32 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035596 Jul 20 19:32:08.083445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 338/672] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:32:08.095514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dd752e2d-015a-45a8-b491-e170a784b28f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.096149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-dd752e2d-015a-45a8-b491-e170a784b28f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:08.180655 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-dd752e2d-015a-45a8-b491-e170a784b28f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.191708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dd752e2d-015a-45a8-b491-e170a784b28f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1214 microversion: 2.1 time: 0.100991 Jul 20 19:32:08.198306 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 339/673] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:08.244314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.254490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3d39ecc9-7618-4376-9bc1-a6d9dfb2f662 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.209223 Jul 20 19:32:08.255090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 335/674] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:08.672989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.673630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:08.680203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.680661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.681461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.681900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.828799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.838711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.840327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.841521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-59031fef-6232-419a-9eff-86e064fb8fc1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.172580 Jul 20 19:32:08.842079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 340/675] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:08.995562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.996337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.003243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.003936 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.004853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.005344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.215396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:09.216074 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.224347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.224804 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.226052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.226521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.331766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.343066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-069c5773-3e0d-4639-a56d-c41bf1ceaa45 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.131727 Jul 20 19:32:09.344193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 341/676] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:09 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:09.348825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:09.349657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.359822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.360623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.361661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.362303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.417659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.425835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-79f49685-9c67-448b-9b07-e44b36792fe9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.434344 Jul 20 19:32:09.426796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 336/677] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:09.452577 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:09.455732 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:09.463355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-db666afd-e272-41b9-a0ae-e5c7ebf989aa tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.117898 Jul 20 19:32:09.465303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 342/678] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:09 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:09.859782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:09.860427 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.867322 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.868065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.868837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.869283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.010753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.019677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.021221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.022380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7d818e9a-5b53-4a4a-b495-2b9b4af1d1b2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.166701 Jul 20 19:32:10.023466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 337/679] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:09 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:10.360784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:10.361400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:10.368158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.368604 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.369498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.369981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.435138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.444193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:10.445037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c9f6a076-b425-4238-b299-2bb0b4956b8d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.087308 Jul 20 19:32:10.445662 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 343/680] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:10 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:10.446227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:10.457966 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.458422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.459202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.459639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.479476 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:10.480181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:10.486431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.486886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.487664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:10.488105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.571808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.580492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3b264d27-ebe8-4349-9a7b-f99ee8fb9310 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.104800 Jul 20 19:32:10.581094 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 344/681] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:10 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:10.647370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.655350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-decd7114-3518-4203-8c12-d269bb4d43d6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.215679 Jul 20 19:32:10.655923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 338/682] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:10 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:11.041029 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.041757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.048134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.048586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.049389 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.049858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.186648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.196900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.198475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.199647 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-85cff364-f10e-4c19-a0b9-00c4b207fc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.162553 Jul 20 19:32:11.200429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 345/683] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:11.462501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.463875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.470608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.471059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.471830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.472267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.540303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.548074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-60d62a19-808f-44c6-8a4c-9b5c531e1e35 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.089791 Jul 20 19:32:11.548842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 339/684] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:11.598306 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.598944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.605807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.606255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.607022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.607454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.674073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.675197 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.679665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.685139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.685848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.686615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.687110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f2c737d5-05d3-450b-b75a-e00b92f8488e tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.092570 Jul 20 19:32:11.687387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.697291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 346/685] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:11.846443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.856195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7d23625c-456f-4874-bf2e-85f16f77d6de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.187164 Jul 20 19:32:11.857809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 340/686] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:12.218445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.218972 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.225247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.226397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.227397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.227841 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.365147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.373990 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.375500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.376743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-33a2e936-10f5-4c77-b2fd-cee88a451355 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.162314 Jul 20 19:32:12.377440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 347/687] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:12.566942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.567702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.574892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.575335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.576165 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.576593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.645470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.654071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-432ec600-0675-4245-8fbd-0b7a4b83544d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.091255 Jul 20 19:32:12.654701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 341/688] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:12.704850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.705492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.712947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.713409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.714199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.714645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.779046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.787061 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-36af89dd-be5e-4df4-8cfb-136226d9576c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.086031 Jul 20 19:32:12.787627 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 348/689] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:12.873758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.874419 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.883929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.884483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.885370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.885885 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.024235 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.031936 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e87d4c5a-1d67-4265-8f38-9c3003a6ae99 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.162135 Jul 20 19:32:13.032514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 342/690] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:13.394268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:13.394880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:13.401011 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.401468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.402254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.402679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.550367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.559947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.561613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.563075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-573c93a6-3c00-4d3d-b9de-0d0ed6031df3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.172548 Jul 20 19:32:13.563717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 349/691] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:13 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:13.672491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:13.673282 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:13.680611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.681088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.681867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.682303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.755108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.763060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f704232d-f07c-4833-96be-d2ca59e5a654 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.094844 Jul 20 19:32:13.763986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 343/692] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:13 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:13.805133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:13.805736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:13.812510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.813346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.814128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.814566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.878501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.886812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c1d3639b-a352-4665-a74a-95cd457094b2 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.086640 Jul 20 19:32:13.887392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 350/693] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:13 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:14.049069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.049700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.071577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.072157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.073057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.073570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.227964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.231651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.236342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7fa5b272-c576-4371-8c8c-c1ef356646eb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.191185 Jul 20 19:32:14.237030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 344/694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:14.581869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.582480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.588760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.589235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.590006 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.590441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.727249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.740316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.742593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.743787 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8a0115de-7714-459a-b4aa-355b8e811f64 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.165929 Jul 20 19:32:14.744333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 351/695] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:14.781188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.781786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.789510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.789959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.790729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.791156 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.859291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.866980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c10e59f7-37a3-4875-bd6a-10d104424bf7 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.089971 Jul 20 19:32:14.867649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 345/696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:14.904153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.904762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.911660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.912111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.913225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.913663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.978022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.986447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5c747004-2b75-42a5-b088-38cbce8cbf77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.086029 Jul 20 19:32:14.987031 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 352/697] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:15.253812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:15.254416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:15.261040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.261485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.262238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.262666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.405225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.413383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-500c513f-10a6-4f45-aec2-a8841af2e604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.163390 Jul 20 19:32:15.413967 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 346/698] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:15.762128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:15.762733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:15.769784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.770236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.771301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.771740 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.885098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:15.886479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:15.894479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.895293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.896175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.896705 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.919810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.930396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.931912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.941626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9c0e2734-dadf-4be2-a774-b12a6a3b0296 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.183224 Jul 20 19:32:15.943546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 353/699] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:15.986071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.995956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1e05ee54-a676-4d14-8ce8-b05cbc25b458 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.115777 Jul 20 19:32:15.996651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 347/700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:16.003424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:16.004070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:16.010291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.010748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.011525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.011972 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.077188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.085405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7d8cd137-c908-49d7-a0a1-b696512c9a04 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.085339 Jul 20 19:32:16.085994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 354/701] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:16.429707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:16.430643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:16.436593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.437093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.437868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.438303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.586953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.594792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-febc262e-ab1b-4810-938c-9363b52ce3b4 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.169179 Jul 20 19:32:16.596554 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 348/702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:16 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:16.961438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:16.962043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:16.968838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.969328 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.970113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.970557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.016167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.016924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.018819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:17.019644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:17.032755 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.034318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.035123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.035822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.117698 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.129530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0c982deb-2a4a-4e77-b23b-a2cb4410c4b9 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.120479 Jul 20 19:32:17.130679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 349/703] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:17.144141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.144959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.147157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.154406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.156123 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.157457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1e561630-f640-4d2d-bd22-4b50861828f8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.200568 Jul 20 19:32:17.158118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 355/704] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:16 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:17.159431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.159888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.165421 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.166014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.242573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.251213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7d32d959-93d8-452b-8d39-8b9dbf56886b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.119207 Jul 20 19:32:17.252047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 350/705] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:17.612316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.612954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.619288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.619744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.620537 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.620984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.783774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.793584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2e060393-be7a-4e31-95fc-fc18ecf2e9b3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.185156 Jul 20 19:32:17.794798 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 356/706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:18.148581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.149573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.156499 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.156977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.157747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.158180 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.177169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.177784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.181983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:18.185653 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=10 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:18.187321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.187765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.188640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.189309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.263430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.279199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9c714ec5-3054-4117-b662-618fad366da4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.134559 Jul 20 19:32:18.289837 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 351/707] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:18.305324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.306043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.324005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.324635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.325614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.326190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.421329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.421329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9d14a5cf-d415-4963-aaf0-68f2e5c3ac38 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.128289 Jul 20 19:32:18.421329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 352/708] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:18.441188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.457387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.459160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.460677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4d33ef65-19bc-49b2-bbbb-544e849323af tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.287519 Jul 20 19:32:18.461548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 357/709] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:18.811154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.811827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.817890 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.818343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.819123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.819688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.948921 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.956400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b9b728d1-8709-4790-b165-c8cc1f027924 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.149414 Jul 20 19:32:18.956986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 353/710] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:19.308307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.308948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:19.315500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.315955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.316761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.317236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.377810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.385359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5fe00e09-b452-41e9-9c3b-cd28562beaeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.081724 Jul 20 19:32:19.385935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 358/711] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:19.437414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.438017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:19.444500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.445115 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.445881 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.446306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.479979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.480773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:19.487233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.487997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.488777 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.489242 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.505761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:19.514208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.521730 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1c99b0a9-868a-4a23-b7f2-4a7ded0e3666 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.088173 Jul 20 19:32:19.522493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 354/712] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:19.625237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.633697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.635206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.636369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b286c8fe-8d05-4cb6-99f3-019b95fd67fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.160745 Jul 20 19:32:19.636956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 359/713] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:19.972716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.973293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:19.980031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.980479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.981256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.981695 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.111363 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.118892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-402ea83a-cd9a-48bc-b296-42dd1283aaca tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.150083 Jul 20 19:32:20.119463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 355/714] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:20.158809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:32:20.159009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:32:20.402555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:20.403166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:20.409704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.410150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.411163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.411591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.475977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.483371 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cb1589f7-28dc-45e8-bc9f-1400cac55035 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.085402 Jul 20 19:32:20.483924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 360/715] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:20 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:20.538353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:20.538984 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:20.545430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.545867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.546618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.547045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.608039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.615607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-830e770a-1c55-4a04-ab59-07005576955f tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.081372 Jul 20 19:32:20.616703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 356/716] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:20 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:20.654503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:20.655076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:20.661564 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.662021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.662901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.663343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.793984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.802781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.805161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.806610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a930b0d9-a03e-4c4a-8bf0-916dea5e8649 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.156079 Jul 20 19:32:20.807170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 361/717] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:20 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:21.135943 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.136548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.142724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.143163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.143918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.144380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.277893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.285310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-628c07b5-b7f7-46e9-8b10-995a813bb78e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.153394 Jul 20 19:32:21.286142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 357/718] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:21.501855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.502412 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.509584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.510037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.510806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.511247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.574804 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.582279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b41c3f48-a8e9-4bb8-873e-288f11974caa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1218 microversion: 2.1 time: 0.084341 Jul 20 19:32:21.582838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 362/719] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:21.642835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.643436 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.653675 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.654126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.654902 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.655334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.721033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.729092 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-36679428-b85f-4320-929e-d3655154621d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1214 microversion: 2.1 time: 0.096074 Jul 20 19:32:21.729663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 358/720] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:21.824791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.825457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.831494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.831941 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.832698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.833154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.118682 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.126949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.128436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.129661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4aca3885-f081-49bd-97f4-b6044c9e6aa2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.308807 Jul 20 19:32:22.130213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 363/721] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:32:22.303104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:22.303944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:22.307163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:22.311704 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.312145 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.313028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.313618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.444863 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.452493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-159dd2a3-dd6f-46ba-a735-0ed64b1135dd tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.153234 Jul 20 19:32:22.453083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 359/722] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:22 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:22.599632 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:22.600323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:22.607299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.607758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.608547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.609020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.672434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.683435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5b038a16-a9d0-4292-93f0-04021deb280b tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1210 microversion: 2.1 time: 0.087694 Jul 20 19:32:22.683894 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 364/723] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:22 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:22.746924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:22.747581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:22.754488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.754828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.755597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.756031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.824229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:22.831811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f7f40a39-4b27-4091-b603-6521ac499bf9 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1270 microversion: 2.1 time: 0.088938 Jul 20 19:32:22.836413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 360/724] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:22 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:23.147789 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:23.148400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:23.154537 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.154981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.155744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.156174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.291439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.301383 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.302913 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.304945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a284b40e-08ea-43de-b5d1-56bc2027e4fc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.161198 Jul 20 19:32:23.305500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 365/725] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:23 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:23.469944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:23.470475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:23.477104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.477555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.478431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.478872 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.498398 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:23.621246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.629608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-629fe4a8-ee19-4119-98b0-5926211f1604 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1370 microversion: 2.1 time: 0.163648 Jul 20 19:32:23.630416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 361/726] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:23 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:23.700102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:23.700706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:23.706828 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.707267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.708037 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.708472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.777047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.790638 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cae73919-4f61-4150-912d-802ffbaa24e6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1266 microversion: 2.1 time: 0.094376 Jul 20 19:32:23.791332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 366/727] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:23 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:23.861463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:23.862362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:23.869551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.870033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.870830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.871351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.933406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.940993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f3ca5c7e-32b1-4ff8-8241-fcf1f68b63f7 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1270 microversion: 2.1 time: 0.094663 Jul 20 19:32:23.941553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 362/728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:23 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:24.324286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.324917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.331589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.332049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.332921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.333316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.472744 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.481342 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.482846 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.483984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e28234f7-3df3-4e22-8395-070dbc1d6ab3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.164563 Jul 20 19:32:24.484530 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 367/729] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:24.646541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.647132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.653961 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.654466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.655272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.655860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.790666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.798241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-36688e6e-ffab-4cf6-912a-9cc39925ae13 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1564 microversion: 2.1 time: 0.155916 Jul 20 19:32:24.799136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 363/730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:24.815017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.815668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.815812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.816374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.822286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.822746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.823110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.823534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.823650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.823977 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.824573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.825111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.896144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.904312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-55ca9f1d-18a8-44c1-8139-65f87bd5b09f tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1266 microversion: 2.1 time: 0.093214 Jul 20 19:32:24.904815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 368/731] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:24.934955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-addf9a38-54d6-4bce-a63b-f257eeaeb3d0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123032 Jul 20 19:32:24.935552 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 364/732] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:32:24.958122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.958776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.965793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.966249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.967081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.967469 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.054937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:25.062445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-13807f70-bd3e-4972-98e9-f4a51ffc1096 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1278 microversion: 2.1 time: 0.108179 Jul 20 19:32:25.063009 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 369/733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:25.507727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:25.508691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:25.515619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.516315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.517112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.517570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.922701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:25.923361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:25.930174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.930633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.931598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.931871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.103668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.111421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e7158199-3c4d-4393-bce1-54d14a3a05cf tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1284 microversion: 2.1 time: 0.192737 Jul 20 19:32:26.111987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 370/734] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:25 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:26.124573 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:26.125335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:26.132186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.132646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.133523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.133965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.254338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.262547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-087ed334-53b6-4e37-b6d9-bf88927d2e70 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1276 microversion: 2.1 time: 0.149431 Jul 20 19:32:26.263107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 371/735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:26 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:26.284737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.293807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.295399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.296663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3a9453a2-eccd-47dd-b9bc-2414b6b9c9d6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.796394 Jul 20 19:32:26.297337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 365/736] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:25 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:27.075893 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-6d611348-5e6f-4918-bbe0-13d2bb8848bc req-fd2ba475-1e90-4887-aeab-91b2e9916d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:27.087891 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-6d611348-5e6f-4918-bbe0-13d2bb8848bc req-fd2ba475-1e90-4887-aeab-91b2e9916d35 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.088626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-6d611348-5e6f-4918-bbe0-13d2bb8848bc req-fd2ba475-1e90-4887-aeab-91b2e9916d35 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.104443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-6d611348-5e6f-4918-bbe0-13d2bb8848bc req-fd2ba475-1e90-4887-aeab-91b2e9916d35 service nova] Creating event network-changed:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:32:27.111517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-6d611348-5e6f-4918-bbe0-13d2bb8848bc req-fd2ba475-1e90-4887-aeab-91b2e9916d35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040530 Jul 20 19:32:27.112909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 372/737] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:27.135709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:27.136670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:27.144487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.145296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.146442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.147875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.279108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.282005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:27.283000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:27.290670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.291392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a354b117-387f-4ab4-8d3a-6b44a9c6a9fd tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1272 microversion: 2.1 time: 0.163415 Jul 20 19:32:27.292667 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.293812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.294439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.305875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 366/738] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:27 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:27.324599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:27.328034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:27.340821 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.344778 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.346832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:27.347527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:27.391053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.402768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7d296049-7213-41fc-87b3-63c4c7b4249b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1276 microversion: 2.1 time: 0.125224 Jul 20 19:32:27.404199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 373/739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:27 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:27.604043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.620317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.623536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:27.625832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-27f5d3fc-ce40-47c3-adad-3ea8240d9cc9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.312779 Jul 20 19:32:27.640983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 367/740] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:27 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:28.311464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:28.312960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:28.322806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.323568 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.324361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.324799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.420073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:28.421635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:28.430532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.431360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.432355 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.433004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.025048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.032450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0ec10cd2-7a62-4245-931a-03cf15849a24 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.616320 Jul 20 19:32:29.033047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 368/741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:28 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:29.037804 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:29.038561 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:29.039233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.044598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.045075 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.045846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.046275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.048250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-bbb0bcf7-9ee1-4870-80e8-9c4602c9d077 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.741203 Jul 20 19:32:29.049806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 374/742] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:28 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:29.263565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-066e5658-3bbf-45b6-8621-426dd2ab7c49 req-add5383d-e68b-4c57-aee3-c04fbf5fb835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "name": "network-vif-plugged", "status": "completed", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:29.274065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-066e5658-3bbf-45b6-8621-426dd2ab7c49 req-add5383d-e68b-4c57-aee3-c04fbf5fb835 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.274689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-066e5658-3bbf-45b6-8621-426dd2ab7c49 req-add5383d-e68b-4c57-aee3-c04fbf5fb835 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.287262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-066e5658-3bbf-45b6-8621-426dd2ab7c49 req-add5383d-e68b-4c57-aee3-c04fbf5fb835 service nova] Creating event network-vif-plugged:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:32:29.292409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-066e5658-3bbf-45b6-8621-426dd2ab7c49 req-add5383d-e68b-4c57-aee3-c04fbf5fb835 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Jul 20 19:32:29.293042 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 375/743] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:32:29.431651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.441291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.442825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:29.444608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a7b2ecd8-8014-4601-a565-7ae81bb4b19a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.410047 Jul 20 19:32:29.445369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 369/744] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:29 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:29.682425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-1ba620bd-0e4c-4b93-95a0-c230b0aa9736 req-2fde1432-5bda-4165-8546-0f1bf6109650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e943ba-e9b0-4b50-94ee-9fc657570555", "tag": "a3f1494b-4a5b-4067-8be0-4a7769ab81cb"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:29.692311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-1ba620bd-0e4c-4b93-95a0-c230b0aa9736 req-2fde1432-5bda-4165-8546-0f1bf6109650 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:29.692766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-1ba620bd-0e4c-4b93-95a0-c230b0aa9736 req-2fde1432-5bda-4165-8546-0f1bf6109650 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:29.710794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-1ba620bd-0e4c-4b93-95a0-c230b0aa9736 req-2fde1432-5bda-4165-8546-0f1bf6109650 service nova] Creating event network-changed:a3f1494b-4a5b-4067-8be0-4a7769ab81cb for instance d7e943ba-e9b0-4b50-94ee-9fc657570555 on hv-cinder-85054 Jul 20 19:32:29.715584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-1ba620bd-0e4c-4b93-95a0-c230b0aa9736 req-2fde1432-5bda-4165-8546-0f1bf6109650 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042669 Jul 20 19:32:29.716192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 376/745] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:30.049098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:30.049882 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:30.056757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.057285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.058055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.058490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.068117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:30.069335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:30.077447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.078282 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.079607 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.080536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.379480 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.383993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.387213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a9d03453-d66c-483f-b1dc-e01437168ca4 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.324703 Jul 20 19:32:30.387789 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 377/746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:30 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:30.391843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8c3fff54-5a83-421a-8926-6d6d3b4ea6bf tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.346576 Jul 20 19:32:30.392404 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 370/747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:30 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:30.462656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:30.463270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:30.469617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.470066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.470829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:30.471263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:30.475570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=100 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:30.662666 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.672155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.673780 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:30.674947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e5b9ae2d-8c3c-4784-bbed-4cee172b690a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.216688 Jul 20 19:32:30.675503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 378/748] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:30 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:31.404641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:31.405350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:31.410273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:31.411150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:31.412997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.413509 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.415309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.416065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.421017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.421737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.423135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.431373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.623568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.626556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.631306 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bd97b2ec-3c9d-415a-af94-b6110e1cd1aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.230497 Jul 20 19:32:31.631960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 371/749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:31 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:31.634810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-09e95894-ac51-4afc-bfd9-4835bdaf8714 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.228420 Jul 20 19:32:31.635382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 379/750] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:31 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:31.694285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:31.695045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:31.702422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.702878 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.703654 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.704095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.730215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-70b7681d-369e-4552-88d6-c7fe3fd7b778 req-281ca826-b668-46c3-9984-1c54a2e4d842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c38ce1-4b0a-4972-831d-bf5c3c98458f", "tag": "b0ba955a-1d57-492d-8bb9-b0e8d72282f5"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:31.738525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-70b7681d-369e-4552-88d6-c7fe3fd7b778 req-281ca826-b668-46c3-9984-1c54a2e4d842 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:31.739056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-70b7681d-369e-4552-88d6-c7fe3fd7b778 req-281ca826-b668-46c3-9984-1c54a2e4d842 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:31.750539 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-70b7681d-369e-4552-88d6-c7fe3fd7b778 req-281ca826-b668-46c3-9984-1c54a2e4d842 service nova] Creating event network-changed:b0ba955a-1d57-492d-8bb9-b0e8d72282f5 for instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f on hv-cinder-85054 Jul 20 19:32:31.755384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-70b7681d-369e-4552-88d6-c7fe3fd7b778 req-281ca826-b668-46c3-9984-1c54a2e4d842 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028786 Jul 20 19:32:31.755979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 380/751] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:32:31.839746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.848265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.849806 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:31.850967 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-09fed2fe-503a-47e1-8990-82e5398f8cae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.160605 Jul 20 19:32:31.851669 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 372/752] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:31 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:32.650641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:32.651350 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:32.651796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:32.652409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:32.653341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:32.659630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.660082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.660521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.661276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.661397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.661721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.662260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.662742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.858235 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:32.861602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:32.867059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9d6a6cc9-3b6e-4883-87c8-eee41c2fbd03 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.219603 Jul 20 19:32:32.867908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 373/753] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:32 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:32.869652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6174fd79-7bec-4228-94f8-ef2857ea50ea tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.224165 Jul 20 19:32:32.870373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 381/754] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:32 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:32.872673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:32.873311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:32.879378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.879826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:32.880630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:32.881109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:33.054976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.063650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.065185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:33.066413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cb87fa19-4b01-4ff9-b6f6-4f45f66bf8e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1808 microversion: 2.20 time: 0.197527 Jul 20 19:32:33.066960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 374/755] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:32 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:33.889834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:33.890449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:33.890835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:33.891240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:33.898693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:33.898892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:33.899283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:33.899546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:33.900106 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:33.900507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:33.900630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:33.900973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:34.285303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.291442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.293762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c60ecb86-630f-4329-8ed1-324a3d5ce6f2 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.407773 Jul 20 19:32:34.294355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 382/756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:33 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:34.298926 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d2d754e6-6d71-4259-b343-17aff8df2121 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.417505 Jul 20 19:32:34.299120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:34.299679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 375/757] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:33 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:34.299790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:34.306063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:34.306521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:34.307300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:34.307739 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:34.589859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.598129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.599645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:34.600783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-92512919-cac9-46b7-9a2d-590fa9ae8ca5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1795 microversion: 2.20 time: 0.305518 Jul 20 19:32:34.601366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 383/758] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:32:34 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1795 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:32:35.311353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:35.312056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:35.315742 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:35.316360 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:35.318603 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.319053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.319830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.320296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.322839 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.323295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.324072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.324521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.518492 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:35.526920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:35.527670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-39b72f59-ee11-4ce1-9825-cb095e51bf28 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.220048 Jul 20 19:32:35.528668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 376/759] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:35 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:35.534911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6e20a3c1-aff9-4397-be01-fc7b7372521d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.222940 Jul 20 19:32:35.535468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 384/760] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:35 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:35.589865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-4d72f294-80d1-4ef2-a323-63a5fc6d4e18 req-9f906f0f-10de-49a2-8fce-1a53b0e7977d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c38ce1-4b0a-4972-831d-bf5c3c98458f", "name": "network-vif-plugged", "status": "completed", "tag": "b0ba955a-1d57-492d-8bb9-b0e8d72282f5"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:35.598202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-4d72f294-80d1-4ef2-a323-63a5fc6d4e18 req-9f906f0f-10de-49a2-8fce-1a53b0e7977d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:35.598746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-4d72f294-80d1-4ef2-a323-63a5fc6d4e18 req-9f906f0f-10de-49a2-8fce-1a53b0e7977d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:35.610566 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-4d72f294-80d1-4ef2-a323-63a5fc6d4e18 req-9f906f0f-10de-49a2-8fce-1a53b0e7977d service nova] Creating event network-vif-plugged:b0ba955a-1d57-492d-8bb9-b0e8d72282f5 for instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f on hv-cinder-85054 Jul 20 19:32:35.615407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-4d72f294-80d1-4ef2-a323-63a5fc6d4e18 req-9f906f0f-10de-49a2-8fce-1a53b0e7977d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030362 Jul 20 19:32:35.616001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 377/761] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:36.544909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:36.545541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:36.552513 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:36.557313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:36.565768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.566225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.568571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.569071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.569865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.571569 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:36.572018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.577059 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:36.955954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:36.964630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-11125092-2e5b-4e9d-8ff1-10a5d244ea3d tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.423576 Jul 20 19:32:36.965254 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 385/762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:36 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:36.968013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:36.975327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1988ee77-753f-447a-9f0b-63735e6b504b tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.427559 Jul 20 19:32:36.975923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 378/763] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:36 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:37.982289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:37.982831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:37.989263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:37.989711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:37.990478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:37.990907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:37.994851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:37.995540 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:38.001868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:38.002317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:38.003106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:38.003525 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:38.009035 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:38.199602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:38.203667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:38.208216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c82c6959-3faf-4fbe-8f4a-d34743123a89 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1314 microversion: 2.1 time: 0.229818 Jul 20 19:32:38.208790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 386/764] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:37 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:38.211867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-23dfc8d2-a588-4fdf-8231-460d49a89d86 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.223005 Jul 20 19:32:38.212429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 379/765] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:37 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:39.224244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:39.224903 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:39.227759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:39.228369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:39.232398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.232855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.233695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.234140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.235453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.235906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.236680 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.237145 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.436861 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:39.440046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:39.444650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6012985b-dbc4-47a2-b88c-906e74cd705d tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.221214 Jul 20 19:32:39.445293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 380/766] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:39 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:39.447964 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5c083602-675c-4c87-9e81-0032d2c48cfa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1499 microversion: 2.1 time: 0.227468 Jul 20 19:32:39.448524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 387/767] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:39 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1499 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:40.017318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-b497e008-6236-4717-9cc1-9d9f602e6ec4 req-19484053-bc5e-4bf1-8578-54f65d0eab4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e943ba-e9b0-4b50-94ee-9fc657570555", "name": "network-vif-plugged", "status": "completed", "tag": "a3f1494b-4a5b-4067-8be0-4a7769ab81cb"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:40.026216 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b497e008-6236-4717-9cc1-9d9f602e6ec4 req-19484053-bc5e-4bf1-8578-54f65d0eab4f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.026739 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b497e008-6236-4717-9cc1-9d9f602e6ec4 req-19484053-bc5e-4bf1-8578-54f65d0eab4f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.038592 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-b497e008-6236-4717-9cc1-9d9f602e6ec4 req-19484053-bc5e-4bf1-8578-54f65d0eab4f service nova] Creating event network-vif-plugged:a3f1494b-4a5b-4067-8be0-4a7769ab81cb for instance d7e943ba-e9b0-4b50-94ee-9fc657570555 on hv-cinder-85054 Jul 20 19:32:40.043754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-b497e008-6236-4717-9cc1-9d9f602e6ec4 req-19484053-bc5e-4bf1-8578-54f65d0eab4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030182 Jul 20 19:32:40.044349 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 381/768] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:40.202603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:40.203320 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:40.209640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.210093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.210906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.211410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.238722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:32:40.318308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-818380ec-18ba-456a-a70c-81ccf483d0aa tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 204 len: 0 microversion: 2.1 time: 0.119269 Jul 20 19:32:40.319022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 388/769] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:32:40 2022] DELETE /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:32:40.329426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:40.331398 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:40.338273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.338726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.339512 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.339954 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.461465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:40.462301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:40.468255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.468701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.469495 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.469930 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.475778 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.484368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f9974143-0063-4d82-be26-61713bb0a1d6 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1505 microversion: 2.1 time: 0.160632 Jul 20 19:32:40.485072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 382/770] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:40 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:40.603111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.611184 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-26dc2bee-7e35-49c7-9d36-89c945ddf337 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.153992 Jul 20 19:32:40.611754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 389/771] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:40 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:41.505907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:41.506742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:41.514106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.514551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.515326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.515752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.539724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:41.540340 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:41.548098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.548552 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.549376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.549824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.657275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.665716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-284a3327-6f8c-4b18-8b24-ac2f6f6e686a tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1505 microversion: 2.1 time: 0.163894 Jul 20 19:32:41.666403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 383/772] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:41 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:41.680210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:41.681072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:41.687164 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.688266 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.689097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.689538 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.823925 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lazy-loading 'services' on Instance uuid 05854927-1ff5-4246-9509-c677fbb0a9f2 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:32:41.929978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0ae104d5-bee2-4f5d-9498-98fb7853d625 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments/568556f3-084f-4242-bf28-97a0482b7399" status: 202 len: 0 microversion: 2.1 time: 0.393774 Jul 20 19:32:41.931040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 390/773] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:32:41 2022] DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments/568556f3-084f-4242-bf28-97a0482b7399 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:32:41.975685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.984318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d7d123b3-1110-4baa-910b-547ba08e74a4 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.307959 Jul 20 19:32:41.984925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 384/774] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:41 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:42.685445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:42.686497 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:42.694048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.694503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.695338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.695812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.842132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:42.850717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3b0c0d63-e819-49f4-ba76-0bf4b83339b0 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1505 microversion: 2.1 time: 0.170966 Jul 20 19:32:42.851298 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 391/775] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:42 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:43.003096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:43.003652 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:43.010464 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.010908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.011973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.012098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.150125 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:43.157601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4d2958a5-a0c3-4281-badb-e7db6ad63390 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1318 microversion: 2.1 time: 0.159600 Jul 20 19:32:43.158161 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 385/776] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:42 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:43.870351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:43.870906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:43.877611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.878064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.878848 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:43.879287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.019141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:44.028278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-73eb01ae-f9ed-49f6-ac48-46c5facc3c9c tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1505 microversion: 2.1 time: 0.162105 Jul 20 19:32:44.028847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 392/777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:43 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:44.175732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:44.176342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:44.184039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.184485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.185303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.185719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.316382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:44.323821 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b600d255-1465-4ca1-b0a7-a6d5d0326403 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1508 microversion: 2.1 time: 0.152181 Jul 20 19:32:44.324376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 386/778] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:44 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:44.340159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "850457d0-17d6-45ab-9d95-308e5d62f9ec", "device": "/dev/sdb"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:44.341855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:44.347880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.348328 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.349137 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.349577 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.352869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:45.045904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:45.046526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:45.053411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.053859 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.055641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.056096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.238966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6573da03-6da7-495c-baee-5e251e747076 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "POST /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903009 Jul 20 19:32:45.239579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 393/779] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:32:44 2022] POST /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:32:45.246272 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:45.247366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:45.255147 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.256128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.257082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.257538 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.274539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:45.282775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7ee24903-9718-438d-a098-4a62a52e6c94 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1505 microversion: 2.1 time: 0.240990 Jul 20 19:32:45.287850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 387/780] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:45 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:45.347366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1d218656-12ee-4a2c-bd36-1ec002109d9a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action" status: 202 len: 0 microversion: 2.1 time: 0.106184 Jul 20 19:32:45.351157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 394/781] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:32:45 2022] POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:32:45.358066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:45.358719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:45.365184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.365801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.366757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.368302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.723968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:45.736392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d23fafd6-88e4-4b14-9d3f-fc1b330e8283 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1751 microversion: 2.1 time: 0.383914 Jul 20 19:32:45.737195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 388/782] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:45 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1751 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:45.776393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-4709ac1c-726e-4f82-bc60-729a89c50bb5 req-989a79bc-423a-4fa3-b28c-edf3c0e4364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c38ce1-4b0a-4972-831d-bf5c3c98458f", "name": "network-vif-deleted", "tag": "b0ba955a-1d57-492d-8bb9-b0e8d72282f5"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:45.785719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4709ac1c-726e-4f82-bc60-729a89c50bb5 req-989a79bc-423a-4fa3-b28c-edf3c0e4364c service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:45.786536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4709ac1c-726e-4f82-bc60-729a89c50bb5 req-989a79bc-423a-4fa3-b28c-edf3c0e4364c service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:45.798403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-4709ac1c-726e-4f82-bc60-729a89c50bb5 req-989a79bc-423a-4fa3-b28c-edf3c0e4364c service nova] Creating event network-vif-deleted:b0ba955a-1d57-492d-8bb9-b0e8d72282f5 for instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f on hv-cinder-85054 Jul 20 19:32:45.804322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-4709ac1c-726e-4f82-bc60-729a89c50bb5 req-989a79bc-423a-4fa3-b28c-edf3c0e4364c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Jul 20 19:32:45.805702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 395/783] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:46.237146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a1353d40-bfc5-4449-8c18-6c697eb93ebf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:46.243986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1353d40-bfc5-4449-8c18-6c697eb93ebf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.244452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1353d40-bfc5-4449-8c18-6c697eb93ebf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.303595 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:46.304345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:46.306389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a1353d40-bfc5-4449-8c18-6c697eb93ebf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Going to try to stop instance {{(pid=117949) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 19:32:46.311317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.311786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.312579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.313028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.352292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a1353d40-bfc5-4449-8c18-6c697eb93ebf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action" status: 202 len: 0 microversion: 2.1 time: 0.118737 Jul 20 19:32:46.353370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 389/784] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:32:46 2022] POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:32:46.361125 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.361337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.361424 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:46.361739 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lazy-loading 'fault' on Instance uuid a3c38ce1-4b0a-4972-831d-bf5c3c98458f {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:32:46.362105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:46.369952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.370456 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.371240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.371679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.418773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb501c4fd084c619501f565dc16277c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f129d1e4d4431c928dc63146543497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.426919 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-34ca49f9-0c7e-46b5-a7b4-19c4001eeeeb tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 200 len: 1304 microversion: 2.1 time: 0.127418 Jul 20 19:32:46.427501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 396/785] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:46 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:46.515848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.523862 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a9130328-d532-46cf-bb47-25370055c3e8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.166015 Jul 20 19:32:46.524429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 390/786] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:46 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:46.754954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:46.755571 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:46.762637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.763092 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.763877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:46.764313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:46.948373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:46.956510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d166902b-3df2-4928-9b4c-d0c35097d006 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1751 microversion: 2.1 time: 0.205464 Jul 20 19:32:46.957098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 397/787] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:46 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:47.444406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:47.445068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] [instance: a3c38ce1-4b0a-4972-831d-bf5c3c98458f] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:47.451407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.451858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.452632 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.453107 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.467003 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] HTTP exception thrown: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Request method failure captured: Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f HTTP/1.1 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FfpyvUBKERxeF1HVdeHJOjJMZQ0AxK8hB5XD8aPxiq3T9yuWZnpcBrUSxFpgwucZBReaHT9tfiGZsJQ2Kc5na40_9q-y1gqNxvUKZHTFKRQJgztbxm1NGif0Aykc7jg0Wr1JdPj2--s_rQmgofc6Jbvw3FVZilI25zPgsw1gQH2StE Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: b1f129d1e4d4431c928dc63146543497 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:32:47.468635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f129d1e4d4431c928dc63146543497", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f129d1e4d4431c928dc63146543497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: b1f129d1e4d4431c928dc63146543497 Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesActionsTest-1272599196 Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesActionsTest-1272599196-project Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 6eb501c4fd084c619501f565dc16277c Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesActionsTest-1272599196-project Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. Jul 20 19:32:47.470260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'a3c38ce1-4b0a-4972-831d-bf5c3c98458f'} Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:32:47.471158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. Jul 20 19:32:47.472623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:32:47.473949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] Returning 404 to user: Instance a3c38ce1-4b0a-4972-831d-bf5c3c98458f could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:32:47.473949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-356a857c-ea43-4e91-8733-e7f9357c4983 tempest-VolumesActionsTest-1272599196 tempest-VolumesActionsTest-1272599196-project] 10.222.0.79 "GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f" status: 404 len: 111 microversion: 2.1 time: 0.029440 Jul 20 19:32:47.473949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 391/788] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:47 2022] GET /compute/v2.1/servers/a3c38ce1-4b0a-4972-831d-bf5c3c98458f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:32:47.542192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:47.542879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:47.549252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.549709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.550501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.550948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.690622 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:47.700904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6dabb1d7-9c1e-47e9-b9fa-07ab17e07e08 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.163316 Jul 20 19:32:47.701810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 398/789] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:47 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:47.974745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:47.975540 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:47.983109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.983557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:47.984334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:47.984814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:48.146010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:48.154999 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bb1f7d6e-014a-4530-ab36-1507493eb960 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.184952 Jul 20 19:32:48.155573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 392/790] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:47 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:48.718400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:48.718933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:48.725610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:48.726034 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:48.727348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:48.727787 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:48.872981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:48.881022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b84c89ce-892a-41a1-bcd4-21ac4e95b00a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.166358 Jul 20 19:32:48.881570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 399/791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:48 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:49.173052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:49.173648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:49.180481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.180983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:49.181719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.182142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:49.340911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:49.349160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f6ffd0b3-2863-4eb9-9683-8d2e29e26f68 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.180169 Jul 20 19:32:49.349741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 393/792] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:49 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:49.899197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:49.899819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:49.906790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.907251 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:49.908035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:49.908479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:50.047233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:50.056063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e9702e2a-80d5-4015-8a14-e60485784ecf tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.161035 Jul 20 19:32:50.056640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 400/793] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:49 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:50.368087 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:50.369413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:50.376987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:50.377439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:50.378202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:50.378629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:50.855558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:50.863760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-22311afd-c846-4e77-acb2-4f0a84f25a4b tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.500652 Jul 20 19:32:50.864343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 394/794] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:50 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:51.073601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:51.074246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:51.081021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.081503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:51.082287 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.082727 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:51.227091 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:51.237549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-595f63bb-5de7-4c83-ba52-3e91fc8a662c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.168370 Jul 20 19:32:51.238139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 401/795] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:51 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:51.881737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:51.882332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:51.889238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.889694 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:51.890482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:51.890955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:52.059331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:52.067637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e3c01514-2490-404c-a5cb-247889f6275c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.189768 Jul 20 19:32:52.068223 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 395/796] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:51 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:52.256801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:52.258443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:52.265454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:52.265911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:52.266700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:52.267141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:52.432301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:52.440866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c8bfb158-eb0e-4366-a57b-ec81d6f24df5 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.189036 Jul 20 19:32:52.441492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 402/797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:52 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:53.084487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:53.085246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:53.088292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=73 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.095050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.095588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.096428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.096986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.104356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.264797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:53.278898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fb29f95d-15bd-47ec-881d-b986af7e31f2 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.198395 Jul 20 19:32:53.280817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 396/798] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:53 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:53.463156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:53.464451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:53.472634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.473117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.473935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:53.474381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:53.651316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:53.661986 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2bbd677d-6b14-4147-a302-664244c92311 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.205684 Jul 20 19:32:53.663093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 403/799] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:53 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:54.302114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:54.304465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:54.317361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.318717 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.320283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.323140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.541386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:54.550557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1dc8a1a9-958d-4e32-bec6-2a78b0cba8ab tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.253350 Jul 20 19:32:54.551149 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 397/800] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:54 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:54.690717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:54.693200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:54.704128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.705111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.706376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:54.706935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:54.870266 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:54.882027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0545fbed-983a-44ec-85fc-c4242e53e840 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.203862 Jul 20 19:32:54.883572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 404/801] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:54 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:55.572702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:55.573478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:55.580905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.581352 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:55.582203 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.582836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:55.758542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:55.767468 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-00af011d-7cf9-4f73-88dd-678daac329df tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.199243 Jul 20 19:32:55.768243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 398/802] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:55 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:55.905709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:55.907416 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:55.915127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.916128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:55.917229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:55.917769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:56.071908 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:56.080982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dbe6cf58-5527-45a9-a6de-9d77b3585afe tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.180340 Jul 20 19:32:56.089578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 405/803] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:55 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:56.784604 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:56.786173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:56.794558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:56.795008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:56.795993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:56.796776 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:56.960454 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:56.969361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f2c53070-9fe7-409b-818b-281430d197eb tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.188530 Jul 20 19:32:56.970309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 399/804] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:56 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:57.097910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:57.099161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:57.106910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:57.107394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:57.108177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:57.108613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:57.276323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:57.295747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2f8a2e8a-b240-4003-b656-688e99ed4bc0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.201074 Jul 20 19:32:57.297183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 406/805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:57 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:57.993462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:57.996635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:58.007551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.008602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:58.010156 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.011083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:58.215790 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:58.227668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cecd403f-c229-4f9a-97a4-05132be86024 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.240658 Jul 20 19:32:58.229064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 400/806] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:57 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:58.314596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:58.315428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:58.323379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.323861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:58.324680 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:58.325310 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:58.481260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:58.483877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:58.492089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1e4b9253-ba85-4796-8a4e-9d92030af674 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.181226 Jul 20 19:32:58.511881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 407/807] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:58 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:59.247240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:59.248527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:59.257267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:59.258100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:59.259100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:59.259735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:59.433253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:59.442697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-19555cdc-effd-4d30-b2d8-be986dfe5224 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.199397 Jul 20 19:32:59.443283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 401/808] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:59 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:59.511771 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:59.513188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:59.521159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:59.521970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:59.531811 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:59.537657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:59.708541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:59.720020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2528ef48-8940-4563-a431-cfd52c7d1008 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.213071 Jul 20 19:32:59.720613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 408/809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:59 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:00.459786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:00.461903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:00.468973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.469797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:00.470675 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.471805 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:00.653222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:00.661477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d93adc2b-1685-4ca2-8fb3-c9d439307d9f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.205459 Jul 20 19:33:00.662048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 402/810] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:00 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:00.878102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:00.878756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:00.885718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.886259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:00.887010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:00.887450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:01.044356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:01.053700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-be183388-8b8a-4c6e-8c8e-02d5e89891bb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.320096 Jul 20 19:33:01.065319 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 409/811] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:00 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:01.682268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:01.682891 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:01.690286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:01.691028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:01.691999 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:01.692623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:01.861562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:01.871996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a28aced7-0ed4-409a-afbd-21ab2c1a629d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.194168 Jul 20 19:33:01.872815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 403/812] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:01 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:02.082196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:02.082821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:02.090272 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.090735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:02.091531 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.091979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:02.246554 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:02.255617 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-31d88042-43b2-4bd4-97ce-854b886de80a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.177334 Jul 20 19:33:02.256186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 410/813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:02 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:02.895764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:02.896412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:02.904158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.904983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:02.906010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:02.906635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:03.066485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:03.075874 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d933da71-7800-417a-97a2-756ef840de33 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.183920 Jul 20 19:33:03.086907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 404/814] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:02 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:03.275257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:03.276971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:03.281224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:03.289565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:03.290694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:03.292544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:03.293267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:03.483112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:03.493114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-38678727-9dcc-48b4-a537-02b9f8f5f598 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.223518 Jul 20 19:33:03.503813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 411/815] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:03 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:04.094214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:04.095488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:04.102475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.102927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.103703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.104340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.268335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:04.278293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7ae86030-5c29-4155-a90e-a0381db891b7 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.187919 Jul 20 19:33:04.279135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 405/816] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:04 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:04.511366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:04.512640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:04.519800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.520521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.521525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:04.522156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:04.679801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:04.689685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cc84b0af-33f9-4900-8eae-9e77964fd0ab tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.182599 Jul 20 19:33:04.690464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 412/817] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:04 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:05.296331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.297209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.303826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.305082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.306082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.306532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.472899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:05.482167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9b9c65ff-dc47-4946-8e27-2db25d5e67de tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.189934 Jul 20 19:33:05.483052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 406/818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:05 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:05.751844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.752679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.761182 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.761894 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.763002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.763621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.972997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:05.986722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dad484ce-5df3-4ede-abe5-dea25d84448c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.246983 Jul 20 19:33:05.988036 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 413/819] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:05 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:06.500212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:06.500935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:06.508465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.509031 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:06.510080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.510594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:06.673293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:06.685399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-73cec8a5-b386-43a9-a7b1-7357f8a67403 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.189255 Jul 20 19:33:06.695856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 407/820] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:06 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:07.005256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:07.006851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:07.014889 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.015697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.016873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.017546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.178274 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.187281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-bf29c75c-36d1-47b1-80ce-8f08567542ea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.186049 Jul 20 19:33:07.188179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 414/821] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:06 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:07.706540 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:07.711712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:07.718760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.719213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.720070 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:07.720522 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.878984 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.888241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-20846408-0e02-4fa8-bdfd-fc31eb118a52 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.185301 Jul 20 19:33:07.899268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 408/822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:07 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:08.199055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.199620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.208265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.209109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.221642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.222105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.223105 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.223671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.226137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.226839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.227553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.228173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.358436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'services' on Instance uuid d7e943ba-e9b0-4b50-94ee-9fc657570555 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:08.451342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.463641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1930bda0-80e5-4048-8e0c-782d6c026598 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555/os-volume_attachments/850457d0-17d6-45ab-9d95-308e5d62f9ec" status: 202 len: 0 microversion: 2.1 time: 0.272455 Jul 20 19:33:08.465170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 415/823] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:33:08 2022] DELETE /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555/os-volume_attachments/850457d0-17d6-45ab-9d95-308e5d62f9ec => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:33:08.471613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f92e9b1a-9dac-4800-9999-7d9a5a6b903e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.267874 Jul 20 19:33:08.483275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 409/824] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:08 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:08.906768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.907664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.915305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.915891 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.916798 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.917375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.081956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.090593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-87f815a3-58f2-477e-8e89-68a3a2321539 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.188020 Jul 20 19:33:09.091509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 416/825] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:08 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:09.493244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:09.494007 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:09.502619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.503232 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.504315 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.504940 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.681734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:09.695995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-41388377-52ff-4eda-a227-866ce7f55369 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1678 microversion: 2.1 time: 0.206185 Jul 20 19:33:09.710792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 410/826] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:09 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:10.108015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.108754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.115373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.115824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.117099 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.117539 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.268701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:10.276946 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-46500e72-0e4a-4ff8-b9d8-2a5b6fedae5c tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.172817 Jul 20 19:33:10.286873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 417/827] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:10 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:10.649341 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.649826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.656321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.656766 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.657560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.657996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.683268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:10.716076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.716694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.718682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:10.723387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.724140 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.725128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.725655 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.763832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-799bc796-b977-4bfc-b007-c3e633125e77 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 204 len: 0 microversion: 2.1 time: 0.118448 Jul 20 19:33:10.764415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 411/828] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:10 2022] DELETE /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:10.773435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:10.774385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:10.780579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.781071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.781842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.782281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.914992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:10.922868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-60c36c59-551c-4340-9ab1-086cd6a09a1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1655 microversion: 2.1 time: 0.210595 Jul 20 19:33:10.923473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 418/829] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:10 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1655 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:10.940013 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4f86ef08-dd67-46cf-91ec-9c6a173241b8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:10.946392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f86ef08-dd67-46cf-91ec-9c6a173241b8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:10.946851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4f86ef08-dd67-46cf-91ec-9c6a173241b8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:10.950953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:10.958581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6129bf9e-d5cd-46ff-9d94-071c600d8c26 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1514 microversion: 2.1 time: 0.189864 Jul 20 19:33:10.959084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 412/830] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:10 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:10.970050 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4f86ef08-dd67-46cf-91ec-9c6a173241b8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Going to try to start instance {{(pid=117948) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 19:33:11.012213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4f86ef08-dd67-46cf-91ec-9c6a173241b8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action" status: 202 len: 0 microversion: 2.1 time: 0.075953 Jul 20 19:33:11.012815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 419/831] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:33:10 2022] POST /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:33:11.021066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:11.021672 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:11.028272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.028711 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.029492 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.029924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.165747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.173297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2d2886fc-f933-46b3-a798-0b01353f60f2 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1664 microversion: 2.1 time: 0.155975 Jul 20 19:33:11.173866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 413/832] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:11 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:11.295584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:11.296278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:11.302630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.303080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.303886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.304317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.447256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:11.455315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5db9db95-125b-43ec-b0d0-5f485d98c7ce tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.164369 Jul 20 19:33:11.455881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 420/833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:11 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:11.975309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:11.975912 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:11.982963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.983406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:11.984341 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:11.984778 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.123534 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.131119 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f09a3af4-673c-4221-9566-a79332f47a35 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1514 microversion: 2.1 time: 0.159547 Jul 20 19:33:12.131698 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 414/834] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:11 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:12.191201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.192039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.198869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.199396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.200239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.200746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.339594 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.347614 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3789fa79-5820-469d-a2e3-6ea12fe85c3d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1664 microversion: 2.1 time: 0.160381 Jul 20 19:33:12.348190 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 421/835] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:12 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:12.471853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.472472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.479376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.479829 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.480599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.481124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.624271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.632202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2ce8308e-109b-4668-9b43-61594afbb712 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.164417 Jul 20 19:33:12.633559 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 415/836] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:12 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:13.148226 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.149077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.155084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.155535 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.156295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.156727 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.366254 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.367501 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.373974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.374419 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.375326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.375763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.494060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.498041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:13.505054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5904f799-21f4-4c1f-a053-27c76806298c tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1514 microversion: 2.1 time: 0.360757 Jul 20 19:33:13.505671 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 422/837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:13.650543 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.652106 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.661706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.662154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.662961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.663396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.725546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.739260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a6eab3dd-5cf2-4e8c-935b-be945f15094f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1664 microversion: 2.1 time: 0.376888 Jul 20 19:33:13.740265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 416/838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1664 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:14.025467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.036651 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3c7b3f2a-52e3-485f-925d-b76d61961e09 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.390513 Jul 20 19:33:14.037447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 423/839] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:14.222867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-756c584d-6579-4630-abe6-7ce0c2ec45de req-907a7c57-aa6e-408a-aa95-0bb0aca3214b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e943ba-e9b0-4b50-94ee-9fc657570555", "name": "network-vif-deleted", "tag": "a3f1494b-4a5b-4067-8be0-4a7769ab81cb"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:14.232549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-756c584d-6579-4630-abe6-7ce0c2ec45de req-907a7c57-aa6e-408a-aa95-0bb0aca3214b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.233338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-756c584d-6579-4630-abe6-7ce0c2ec45de req-907a7c57-aa6e-408a-aa95-0bb0aca3214b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.244955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-756c584d-6579-4630-abe6-7ce0c2ec45de req-907a7c57-aa6e-408a-aa95-0bb0aca3214b service nova] Creating event network-vif-deleted:a3f1494b-4a5b-4067-8be0-4a7769ab81cb for instance d7e943ba-e9b0-4b50-94ee-9fc657570555 on hv-cinder-85054 Jul 20 19:33:14.249747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-756c584d-6579-4630-abe6-7ce0c2ec45de req-907a7c57-aa6e-408a-aa95-0bb0aca3214b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030609 Jul 20 19:33:14.250386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 417/840] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:14.522528 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:14.523766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.532271 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.532808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.533845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.534476 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.569362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.569963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.570417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'fault' on Instance uuid d7e943ba-e9b0-4b50-94ee-9fc657570555 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:14.614270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.622227 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6b5e585f-30a5-4ddb-930f-d64cede24e66 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1308 microversion: 2.1 time: 0.103561 Jul 20 19:33:14.622696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 424/841] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:14 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:14.758776 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:14.759628 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.769900 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.770453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.771122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.771870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.912522 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:14.920143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-13fc166f-f3e0-462e-816d-f517cc439bb0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1664 microversion: 2.1 time: 0.166577 Jul 20 19:33:14.920965 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 418/842] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:14 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:15.055042 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.055760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.061889 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.062256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.063050 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.063478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.222684 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.236221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-694059f0-97ca-4086-9849-47cb1302357f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1756 microversion: 2.1 time: 0.185534 Jul 20 19:33:15.236812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 425/843] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:15.639349 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.640141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.646854 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.647300 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.648129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.648576 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.681099 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.681743 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.682207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lazy-loading 'fault' on Instance uuid d7e943ba-e9b0-4b50-94ee-9fc657570555 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:15.738857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73da7d7237d4c9cb11c60a84e4dccd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa8c8dd804b46ca8996788a32b8383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.747542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8e9522c9-6f6e-42a0-bd96-27f6208a9279 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 200 len: 1308 microversion: 2.1 time: 0.112225 Jul 20 19:33:15.756092 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 419/844] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:15.937285 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.937928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.946532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.946992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.947918 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.948475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.087717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.095330 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4e101764-c35d-4fde-b982-dd668e9a2c4c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1668 microversion: 2.1 time: 0.161925 Jul 20 19:33:16.095897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 426/845] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:16.255012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.255574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.263014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.263423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.264376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.264848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.413338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.421334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-44c92a71-fa66-4965-9da5-f590cf9c3812 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1759 microversion: 2.1 time: 0.170295 Jul 20 19:33:16.421902 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 420/846] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:16.742309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.742814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.748964 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.749424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.750195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.750636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.765200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.766131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] [instance: d7e943ba-e9b0-4b50-94ee-9fc657570555] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.774474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.775046 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.775975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.776384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:16.776516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.791359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] HTTP exception thrown: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Request method failure captured: Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 HTTP/1.1 Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FeXYouUNqcsNUJ6uPXHESQjK2XtzgLEM6Hvlipu_Fk7fy50GhORrtxPxXrfRH5JUmWuGjhSC4Ee9tIINRN8R5FctAeEhrUFEsQUrfjPT4FGXISIairZjl9TOZiR-ReMTLRXO2mAF5tYATpw9YTOUEtBp864m0mlsT_7YIin1wQmeKE Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 2aa8c8dd804b46ca8996788a32b8383e Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:33:16.793118 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2aa8c8dd804b46ca8996788a32b8383e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2aa8c8dd804b46ca8996788a32b8383e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 2aa8c8dd804b46ca8996788a32b8383e Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-335840475 Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-VolumesSnapshotTestJSON-335840475-project Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: e73da7d7237d4c9cb11c60a84e4dccd8 Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-VolumesSnapshotTestJSON-335840475-project Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. Jul 20 19:33:16.794712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'd7e943ba-e9b0-4b50-94ee-9fc657570555'} Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:16.795692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. Jul 20 19:33:16.797027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:33:16.798137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] Returning 404 to user: Instance d7e943ba-e9b0-4b50-94ee-9fc657570555 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:16.798137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7660c1fb-c2fb-45ae-8ff5-ae64ab5e2f17 tempest-VolumesSnapshotTestJSON-335840475 tempest-VolumesSnapshotTestJSON-335840475-project] 10.222.0.79 "GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555" status: 404 len: 111 microversion: 2.1 time: 0.033598 Jul 20 19:33:16.798137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 421/847] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/d7e943ba-e9b0-4b50-94ee-9fc657570555 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:33:16.881453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cb0bea37-f04c-4e50-8847-3d6957966864 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 204 len: 0 microversion: 2.1 time: 0.143303 Jul 20 19:33:16.883326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 427/848] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:16 2022] DELETE /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:16.891668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.892284 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.899470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.900188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.901174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.912781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.084753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:17.093011 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2f8590de-47ed-43f4-b632-ba763faa8a14 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1576 microversion: 2.1 time: 0.205152 Jul 20 19:33:17.103455 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 422/849] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:18.111291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:18.112043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:18.119256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.119731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.120678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.121006 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.257219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:18.265217 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-83445b9a-7799-4bb8-80f1-652024e57400 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1576 microversion: 2.1 time: 0.158174 Jul 20 19:33:18.265801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 428/850] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:18 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:19.283886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.284500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:19.291430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.291877 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.292640 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.293110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.423927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:19.431312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e7549c9a-47ea-4344-bd3b-c141b2d5189e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1576 microversion: 2.1 time: 0.152408 Jul 20 19:33:19.431866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 423/851] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:19 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:20.448271 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.449053 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.455562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.456010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.456775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.457233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.596278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:20.606643 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ee702f5f-6680-4da8-b6bc-d1f286d0b6e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1576 microversion: 2.1 time: 0.162322 Jul 20 19:33:20.607229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 429/852] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:20 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:21.624080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:21.624719 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:21.631874 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.632325 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.633933 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:21.634354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.842356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.850459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0702f1f7-15e1-42c0-958b-a3fed05fbd8a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1576 microversion: 2.1 time: 0.230296 Jul 20 19:33:21.851111 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 424/853] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:21 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:22.246317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-cf34ce03-d9e2-46de-a0a2-cb4a2c8d4d8f req-df882556-71ad-411f-b8e4-92af436eb9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000b3a8a-e2f6-4b99-b44b-add74e40f420", "name": "network-vif-deleted", "tag": "caa55c24-a3af-4dbe-9f01-010be87c9cc7"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:22.254551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-cf34ce03-d9e2-46de-a0a2-cb4a2c8d4d8f req-df882556-71ad-411f-b8e4-92af436eb9f6 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.254994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-cf34ce03-d9e2-46de-a0a2-cb4a2c8d4d8f req-df882556-71ad-411f-b8e4-92af436eb9f6 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.266897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-cf34ce03-d9e2-46de-a0a2-cb4a2c8d4d8f req-df882556-71ad-411f-b8e4-92af436eb9f6 service nova] Creating event network-vif-deleted:caa55c24-a3af-4dbe-9f01-010be87c9cc7 for instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 on hv-cinder-85054 Jul 20 19:33:22.272111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-cf34ce03-d9e2-46de-a0a2-cb4a2c8d4d8f req-df882556-71ad-411f-b8e4-92af436eb9f6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158144 Jul 20 19:33:22.272712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 430/854] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:22.868102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:22.869065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:22.876274 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.876730 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.877530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.877968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.950869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.959409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0a224827-31a4-40c1-9815-4e6dac8e84ea tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1511 microversion: 2.1 time: 0.095506 Jul 20 19:33:22.960213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 425/855] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:22 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:23.978592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:23.979587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:23.986895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.987448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.988588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.988865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.060191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:24.068370 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9716a601-ec95-4244-846e-e6b1451aee61 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1226 microversion: 2.1 time: 0.094955 Jul 20 19:33:24.069234 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 431/856] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:23 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:25.085288 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:25.085895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:25.090246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:25.095078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:25.096208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:25.097495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:25.097999 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:25.136083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:25.136529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:25.137002 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lazy-loading 'fault' on Instance uuid 000b3a8a-e2f6-4b99-b44b-add74e40f420 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:25.181012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:25.191305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fc79ec35-06f0-4f07-96c1-60d64d3877f7 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 200 len: 1231 microversion: 2.1 time: 0.110050 Jul 20 19:33:25.191869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 426/857] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:25 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:26.209703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:26.210324 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:26.217354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.217814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.218600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.219045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.233949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] HTTP exception thrown: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Request method failure captured: Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 HTTP/1.1 Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdxUlITYk0N5dpa5vFa4rfWNNWdm8rfhfsVPa-0fwdJMsmOuhAEMKiPsteV6183Wqa0P8CCO89JTSlE0gU-N4Z3ooCbz1itIsl0dp_twtambAQSERPaJvpbreRQ3z_CGshPyMf4_Jn2BAHsta2cJHyHrj7J5kpM3zvbT3mz2App72Y Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:33:26.236838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3f1255754afb4cd384a11c87a9d717df", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 493d126879f44b26951920235e7f7730 Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:33:26.238501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '000b3a8a-e2f6-4b99-b44b-add74e40f420'} Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:26.239486 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:33:26.241402 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:26.244203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Returning 404 to user: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:26.244203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-286b68f9-4dfb-4744-9b01-642a6125b294 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 404 len: 111 microversion: 2.1 time: 0.033844 Jul 20 19:33:26.244203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 432/858] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:26 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:26.351993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1492652197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006792000", "security_groups": [{"name": "tempest-secgroup-smoke-7941455"}], "block_device_mapping_v2": [{"uuid": "d6a2a4ca-58e8-44ad-9af9-89d9dcd09c5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b"}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:26.472228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] validate_networks() for [('bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:33:26.957093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:33:26.957591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:33:26.958200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:33:26.958737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:33:26.959278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:33:26.968903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.969471 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.970188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:26.970627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:26.987812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:33:26.991786 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for user 493d126879f44b26951920235e7f7730 and project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:33:27.052168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:33:27.054386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6a2a4ca-58e8-44ad-9af9-89d9dcd09c5f',volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:33:27.186903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5ac86d7d-5af8-45e9-ba73-72f7ebe47f87 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.839102 Jul 20 19:33:27.187722 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 427/859] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:33:26 2022] POST /compute/v2.1/servers => generated 403 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:33:27.198357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b93acd34-7e07-44d6-9142-5ad6ec59aece tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:27.198969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b93acd34-7e07-44d6-9142-5ad6ec59aece tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:27.255229 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b93acd34-7e07-44d6-9142-5ad6ec59aece tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.262524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b93acd34-7e07-44d6-9142-5ad6ec59aece tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1095 microversion: 2.1 time: 0.068761 Jul 20 19:33:27.263191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 433/860] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:27 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:28.280417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:28.281005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:28.287935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.288390 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.289187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.289625 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.353346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:28.361465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bc69c736-7e94-47cd-8d07-efcdd174dc5c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1193 microversion: 2.1 time: 0.085401 Jul 20 19:33:28.362045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 428/861] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:28 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:29.382579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:29.383357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:29.392021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.392625 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.393924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:29.394150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.582635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.592941 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fb31e3ed-654b-4b71-bdf0-c517f37d4a6d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1276 microversion: 2.1 time: 0.214190 Jul 20 19:33:29.594478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 434/862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:29 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:30.269143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-95dc2ebf-8c99-495a-a23b-51cd47d125fe req-8826f0bf-e1ad-4711-ba22-8e40bb0c56c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a7d635-c0fb-46d2-b8be-44ee48e97672", "tag": "adb97b7c-ab6c-4cac-8466-afb36a56cddd"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:30.277897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-95dc2ebf-8c99-495a-a23b-51cd47d125fe req-8826f0bf-e1ad-4711-ba22-8e40bb0c56c3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.278443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-95dc2ebf-8c99-495a-a23b-51cd47d125fe req-8826f0bf-e1ad-4711-ba22-8e40bb0c56c3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.282571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:30.291807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-95dc2ebf-8c99-495a-a23b-51cd47d125fe req-8826f0bf-e1ad-4711-ba22-8e40bb0c56c3 service nova] Creating event network-changed:adb97b7c-ab6c-4cac-8466-afb36a56cddd for instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 on hv-cinder-85054 Jul 20 19:33:30.299787 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-95dc2ebf-8c99-495a-a23b-51cd47d125fe req-8826f0bf-e1ad-4711-ba22-8e40bb0c56c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Jul 20 19:33:30.300317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 429/863] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:33:30.612318 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:30.612864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:30.619696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.620163 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.620969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.621433 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.760109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.767778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4056ba22-b829-41e9-b62c-b63240edd6c6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.159375 Jul 20 19:33:30.768347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 435/864] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:30 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:31.786653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:31.787342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:31.794907 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.795348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.796100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.796526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.930366 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:31.939878 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a1a39b53-868f-419c-86a0-9e4f75f07b33 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.157322 Jul 20 19:33:31.940453 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 430/865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:31 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:32.956972 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:32.957515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:32.964702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.965327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.966090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.966522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.107424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.115215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1d48d3ab-eacd-4e2d-b4e6-67388d4d3976 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.162214 Jul 20 19:33:33.115802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 436/866] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:32 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:34.132949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:34.133565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:34.140957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.141265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.142082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.142556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.295749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.303210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a543da86-d94f-4673-ad42-14a8b011ceda tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.173994 Jul 20 19:33:34.303779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 431/867] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:34 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:35.320510 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:35.321783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:35.324507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:35.330279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.330739 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.331600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.332081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.466850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:35.474375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b5bd6b37-29f5-4d3a-b0de-61f0893bb241 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.158175 Jul 20 19:33:35.474941 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 437/868] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:35 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:35.836369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da975c87-24c5-41d4-a8c7-7e403b4e50d1"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:35.837733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:35.844598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.845095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.845866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.846301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.147856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d96639b7-27b2-499e-a16f-8c85809ed3de tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492431 Jul 20 19:33:36.148470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 432/869] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:33:35 2022] POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:36.491633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:36.492255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:36.500444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.500938 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.501734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.502178 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.637501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.645016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6fb6275b-76c5-46b2-8bdd-1e5390ae084d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.157442 Jul 20 19:33:36.645623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 438/870] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:36 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:37.553860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:37.554622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:37.661863 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.662558 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.664955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:37.672222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.672674 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.672782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.673414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.673524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.673907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.679559 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.680001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.680753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.681238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.717172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-79219c8d-e647-4b7f-86d6-5e65f4330dc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments/04ce8777-a0ce-4f53-8cfa-fbce5916d5ab" status: 200 len: 194 microversion: 2.20 time: 0.168891 Jul 20 19:33:37.717763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 433/871] 10.222.0.79 () {60 vars in 1453 bytes} [Wed Jul 20 19:33:37 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments/04ce8777-a0ce-4f53-8cfa-fbce5916d5ab => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:37.783342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.783891 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.791780 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.792337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.793413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.793930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.816334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:37.818581 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:37.826706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b760e191-08e1-4cfb-9f84-e681f5b15938 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.168896 Jul 20 19:33:37.827288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 439/872] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:37 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:37.926112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lazy-loading 'services' on Instance uuid 27cf917f-83ab-47d0-82d4-8d8dc896aacb {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:38.203970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f6780107-62fd-448c-ac43-0b69413ce66b tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments/04ce8777-a0ce-4f53-8cfa-fbce5916d5ab" status: 202 len: 0 microversion: 2.20 time: 0.424409 Jul 20 19:33:38.205389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 434/873] 10.222.0.79 () {60 vars in 1456 bytes} [Wed Jul 20 19:33:37 2022] DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments/04ce8777-a0ce-4f53-8cfa-fbce5916d5ab => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:33:38.215363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:38.216427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:38.223401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.223848 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.224823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.225359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.257133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-17eff8e7-9dba-4eef-9bde-d5e6d66c4d49 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047432 Jul 20 19:33:38.257701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 440/874] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:38 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:38.844272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:38.844998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:38.851787 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.852251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.853027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.853964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.989445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.998354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8ca2237c-5f65-49a0-af1f-df057c05957c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.158341 Jul 20 19:33:38.999039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 435/875] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:38 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:39.271232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:39.272159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:39.279442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.279904 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.280677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.281148 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.315457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6b417ff8-c21e-45a5-b983-238481e73d89 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048200 Jul 20 19:33:39.316051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 441/876] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:39 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:40.015721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:40.016285 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:40.022912 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.023363 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.024166 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.024607 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.162537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:40.170581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-70375ed6-ef8f-4fb1-afa7-7e68cea176ae tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.158838 Jul 20 19:33:40.171338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 436/877] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:40 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:40.328332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:40.329286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:40.335839 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.336298 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.337113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:40.338247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:40.367783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c670c4d7-d769-43ba-8319-23a7c826db87 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043495 Jul 20 19:33:40.368404 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 442/878] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:40 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:41.188238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:41.188855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:41.195293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.195741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.196627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.197157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.330924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:41.339094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ca25efe1-72cf-493a-a179-c974be1f24dd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.154714 Jul 20 19:33:41.339683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 437/879] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:41 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:41.379021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:41.379957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:41.386492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.386945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.387719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:41.388159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:41.418442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b2bf6d2a-5f32-4ee2-a125-5a3e4d3482db tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043364 Jul 20 19:33:41.419008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 443/880] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:41 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:42.356005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:42.357122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:42.363820 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.364269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.365071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.365513 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.430378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:42.431303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:42.438871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.439319 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.440097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:42.440533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:42.470957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b6dc2ea0-6420-40c8-8244-e7fbb6cd9238 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044567 Jul 20 19:33:42.471545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 444/881] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:42 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:33:42.502195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:42.510013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-46ef1391-bdbf-436c-977b-c678754671ed tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.158054 Jul 20 19:33:42.510574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 438/882] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:42 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:43.483635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:43.484596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.491476 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.491931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.492734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.493203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.526315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7604da94-6df0-4b46-a3e8-56f250e6e4d1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047291 Jul 20 19:33:43.526854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 445/883] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:43 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:33:43.527108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:43.528586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.537968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.538409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.539231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.539659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.686578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:43.688176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.695920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.696600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.698875 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.700326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.721617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:43.727291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lazy-loading 'flavor' on Instance uuid 82e10053-0587-4935-910f-04bd301bdfbe {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:43.729998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b7cca449-6a02-49a8-ad0f-2ba4c727a915 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.207031 Jul 20 19:33:43.731716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 439/884] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:43 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:43.891100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-495889da-3ed0-469c-864f-baa8bb867951 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/action" status: 200 len: 32 microversion: 2.1 time: 0.209660 Jul 20 19:33:43.900484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 446/885] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:33:43 2022] POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 19:33:43.904814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:43.905686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:43.915484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.916168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:43.917461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:43.920154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.173571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:44.182457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7ba22f49-4dd3-4f85-94dd-ccdbdf678c3b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.281860 Jul 20 19:33:44.183051 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 440/886] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:43 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:44.541817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.543849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:44.552302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.553413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.555085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.555649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.594499 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8eceb0c1-7713-486c-ab43-b632bf5025ef tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059715 Jul 20 19:33:44.595196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 447/887] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:33:44 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:44.666524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.667071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:44.674791 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.675340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.676335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.676769 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.707877 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:44.750459 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.751074 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:44.759318 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.760064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.761093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.762237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.843241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b02bc23c-34ed-4507-b589-1c057bd73f56 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 204 len: 0 microversion: 2.20 time: 0.182205 Jul 20 19:33:44.844420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 441/888] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 19:33:44 2022] DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:33:44.853633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:44.854601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:44.865005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.867899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:44.869176 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:44.869640 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.014749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.023046 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a3423c88-3084-470f-8dfc-8957ef99b438 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.278107 Jul 20 19:33:45.023880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 448/889] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:44 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:45.066625 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.070331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:45.076737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.078596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.079799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-74cc10f4-4d9c-4016-b10c-a77b4b97dd3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.231076 Jul 20 19:33:45.080365 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 442/890] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:44 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:45.202289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:45.202959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:45.209286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.209803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.210687 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.211435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.261458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-255c74f3-b013-4ca3-8b19-62c6dd656a0e req-63e5b0bf-01de-4119-b578-ed0a4fe3e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a7d635-c0fb-46d2-b8be-44ee48e97672", "name": "network-vif-plugged", "status": "completed", "tag": "adb97b7c-ab6c-4cac-8466-afb36a56cddd"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:45.273738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-255c74f3-b013-4ca3-8b19-62c6dd656a0e req-63e5b0bf-01de-4119-b578-ed0a4fe3e9ca service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:45.274222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-255c74f3-b013-4ca3-8b19-62c6dd656a0e req-63e5b0bf-01de-4119-b578-ed0a4fe3e9ca service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:45.286581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-255c74f3-b013-4ca3-8b19-62c6dd656a0e req-63e5b0bf-01de-4119-b578-ed0a4fe3e9ca service nova] Creating event network-vif-plugged:adb97b7c-ab6c-4cac-8466-afb36a56cddd for instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 on hv-cinder-85054 Jul 20 19:33:45.291637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-255c74f3-b013-4ca3-8b19-62c6dd656a0e req-63e5b0bf-01de-4119-b578-ed0a4fe3e9ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035739 Jul 20 19:33:45.292473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 443/891] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:33:45.357854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:45.365945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3d410d39-f42c-41b6-afc0-968cb5c7753e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.168465 Jul 20 19:33:45.366546 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 449/892] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:45 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:46.044774 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:46.045500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:46.051747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.052193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.052974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.053412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.099829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:46.100449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:46.125370 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.125829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.126698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.127170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.457433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.465653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d42cd740-9ba7-4fc9-a821-b4e14064cff4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.425530 Jul 20 19:33:46.466454 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 444/893] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:46 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:46.471256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:46.471864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:46.477860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.478307 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.479098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:46.479511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:46.537602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.545957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.547477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.548640 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-63b5b58d-7ab1-49cb-9162-42fb9f9c1ffd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.453043 Jul 20 19:33:46.549251 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 450/894] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:46 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:46.623234 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:46.631185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-29bb223d-8916-4526-8899-97161c1d1caf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.163590 Jul 20 19:33:46.631740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 445/895] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:46 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:47.484197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:47.484815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:47.491417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.491870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.492637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.493103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.567775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:47.568392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:47.575124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.575572 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.576343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.576781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.807111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.816176 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-64fe3dee-84f5-4cf5-9426-94127ddfd16f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.336625 Jul 20 19:33:47.816761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 451/896] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:47 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:47.821206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:47.821835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:47.828490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.828979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.829765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:47.830220 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:47.841405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.850892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.852696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:47.853888 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3b2dd3be-e80b-4941-a2a6-cd74d1f03eb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1723 microversion: 2.20 time: 0.290120 Jul 20 19:33:47.854477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 446/897] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:47 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:48.090766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.098924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-71774078-59fe-47d8-9bbc-2eb9a1e69dc1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.281142 Jul 20 19:33:48.099536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 452/898] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:47 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:48.552663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-fbb1836c-dbdd-46eb-8c80-f8ec59794178 req-c965e2f2-9669-42e8-a11c-3e0ffbbc35ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cf917f-83ab-47d0-82d4-8d8dc896aacb", "name": "network-vif-deleted", "tag": "8de6f1a3-1533-4778-946a-bfef39df578f"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:48.563781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-fbb1836c-dbdd-46eb-8c80-f8ec59794178 req-c965e2f2-9669-42e8-a11c-3e0ffbbc35ff service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.564329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-fbb1836c-dbdd-46eb-8c80-f8ec59794178 req-c965e2f2-9669-42e8-a11c-3e0ffbbc35ff service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.576082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-fbb1836c-dbdd-46eb-8c80-f8ec59794178 req-c965e2f2-9669-42e8-a11c-3e0ffbbc35ff service nova] Creating event network-vif-deleted:8de6f1a3-1533-4778-946a-bfef39df578f for instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb on hv-cinder-85054 Jul 20 19:33:48.581463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-fbb1836c-dbdd-46eb-8c80-f8ec59794178 req-c965e2f2-9669-42e8-a11c-3e0ffbbc35ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Jul 20 19:33:48.582065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 447/899] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:48.833786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:48.834554 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:48.841906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.842367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.843150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.843765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.874843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:48.875635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:48.882700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.883398 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.884178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.884613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.917874 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:48.919492 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:48.919952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lazy-loading 'fault' on Instance uuid 27cf917f-83ab-47d0-82d4-8d8dc896aacb {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:48.979801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:48.998431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.002338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.003928 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-47fe5046-e7ec-42d9-8853-fecb97daf9d5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1371 microversion: 2.20 time: 0.134082 Jul 20 19:33:49.005529 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 448/900] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:48 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:49.012601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.023947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ff581943-0145-42e1-bde8-b1eb426fada2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1264 microversion: 2.1 time: 0.193966 Jul 20 19:33:49.024545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 453/901] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:48 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:49.115546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:49.116391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:49.122594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.123046 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.123811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:49.124244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:49.265023 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:49.273278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-33ab3644-8277-4fbb-8c81-f579521eaab8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.161503 Jul 20 19:33:49.274193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 449/902] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:49 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:50.023072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.023689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.031005 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.031473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.032252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.032694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.041970 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.042556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.049791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:50.052507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.054257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.055072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.055523 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.076244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.076721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.077196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lazy-loading 'fault' on Instance uuid 27cf917f-83ab-47d0-82d4-8d8dc896aacb {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:50.157683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.165213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.167010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.173215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6a13fea5-01d2-403a-b7f1-b8effa9565d8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 200 len: 1371 microversion: 2.20 time: 0.153914 Jul 20 19:33:50.174139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 454/903] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:50.291789 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.292524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.299619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.300078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.300858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.301346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.311898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.319558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c1442f89-fde2-45be-a5ac-cdd99f558a1f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1451 microversion: 2.1 time: 0.281350 Jul 20 19:33:50.330848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 450/904] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1451 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:50.336243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:50.337030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:50.344049 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.344601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.345435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:50.345879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:50.602438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.611569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:50.611789 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-73444bea-5651-46d5-a1ef-63cd4ce8fef9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.323859 Jul 20 19:33:50.612393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 455/905] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:50.620228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2b4cd35a-81ae-454e-9ff7-c059c2518d6f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1451 microversion: 2.1 time: 0.287900 Jul 20 19:33:50.620929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 451/906] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:50 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1451 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:51.192775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:51.193569 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:51.200296 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.200832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.201729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.202259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.216445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb HTTP/1.1 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:33:51.218487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:33:51.220189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '27cf917f-83ab-47d0-82d4-8d8dc896aacb'} Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:51.221193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:33:51.222694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:33:51.224379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:51.224379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-57961eea-779e-4d11-9658-863c9a902703 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 404 len: 111 microversion: 2.20 time: 0.032657 Jul 20 19:33:51.226032 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 456/907] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:51 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:33:51.232779 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b04b885e-35be-427b-9e58-9f840fc38a44 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '.version_select at 0x7f0e85ca4ca0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:51.258257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b04b885e-35be-427b-9e58-9f840fc38a44 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923695319" status: 204 len: 0 microversion: 2.20 time: 0.030871 Jul 20 19:33:51.263148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 452/908] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 19:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923695319 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:33:51.629338 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:51.630138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:51.636255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.637249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.638040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:51.638487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:51.855831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:51.864913 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6446d0ef-a60f-458e-9e87-ed0fc5843b60 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.239464 Jul 20 19:33:51.876674 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 457/909] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:51 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:52.042930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-21fd0dd8-8d95-4928-8edb-19fcaaae15fa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: .version_select at 0x7f0e8a4b8f70>, body: {"keypair": {"name": "tempest-keypair-925748532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwYraEav58p0ReTIhkQAPziyPrwD0Ba9+mh3Mq2dVeMVqU6qTgTdYM/dbiqVa14zlQFQw3vBCwnoQ3HqFOF/jo5np3Fn4hEmKMZ+WX0jyjcXjDaLVz9O8WixUT4L2q7nA=="}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:52.058179 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-21fd0dd8-8d95-4928-8edb-19fcaaae15fa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for project ca9f11498f9d4245910281ac3bd55470. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:33:52.062514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-21fd0dd8-8d95-4928-8edb-19fcaaae15fa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for user c18c8d4034ce40dba9f9f48e96a19814 and project ca9f11498f9d4245910281ac3bd55470. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:33:52.085409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-21fd0dd8-8d95-4928-8edb-19fcaaae15fa tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046396 Jul 20 19:33:52.086009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 453/910] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 19:33:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 19:33:52.755286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-192c89cf-4485-4a09-b4e2-066df3ff27e6 req-bfdcb27b-f844-4dac-a4ff-ff5d6609eb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a7d635-c0fb-46d2-b8be-44ee48e97672", "tag": "adb97b7c-ab6c-4cac-8466-afb36a56cddd"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:52.764565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-192c89cf-4485-4a09-b4e2-066df3ff27e6 req-bfdcb27b-f844-4dac-a4ff-ff5d6609eb10 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.765050 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-192c89cf-4485-4a09-b4e2-066df3ff27e6 req-bfdcb27b-f844-4dac-a4ff-ff5d6609eb10 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.779910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-192c89cf-4485-4a09-b4e2-066df3ff27e6 req-bfdcb27b-f844-4dac-a4ff-ff5d6609eb10 service nova] Creating event network-changed:adb97b7c-ab6c-4cac-8466-afb36a56cddd for instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 on hv-cinder-85054 Jul 20 19:33:52.787294 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-192c89cf-4485-4a09-b4e2-066df3ff27e6 req-bfdcb27b-f844-4dac-a4ff-ff5d6609eb10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250501 Jul 20 19:33:52.787912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 458/911] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:52.883250 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:52.884061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:52.895387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.896132 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:52.897790 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:52.898340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:53.508758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:53.518134 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ae8b84cc-1a77-4041-a359-9c0d6033e692 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.638782 Jul 20 19:33:53.519064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 454/912] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:52 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:54.219423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1000238125", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c252680c-c029-4238-80e1-835b5a8591d8"}], "security_groups": [{"name": "tempest-securitygroup--811766868"}], "key_name": "tempest-keypair-925748532", "user_data": "}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:54.327644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] validate_networks() for [('c252680c-c029-4238-80e1-835b5a8591d8', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:33:54.535396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:54.536006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:54.542756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.543244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.544115 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.544553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.741648 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:54.750386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2dd54479-a77c-4e18-af2e-26ee4cbde5cf tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.218779 Jul 20 19:33:54.750962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 455/913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:54 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:54.853428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:33:54.853855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:33:54.854332 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:33:54.854745 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:33:54.855159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:33:54.864492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.864975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.865895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:54.866374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:54.883413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for project ca9f11498f9d4245910281ac3bd55470. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:33:54.887928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Getting quotas for user c18c8d4034ce40dba9f9f48e96a19814 and project ca9f11498f9d4245910281ac3bd55470. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:33:54.899018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:33:54.901382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:33:54.954312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4ce0ac0c-eff0-435c-bf70-2fd516fe0834 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.741144 Jul 20 19:33:54.954960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 459/914] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 19:33:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 19:33:54.965028 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:54.965642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:54.973517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:55.021035 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.028297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.029823 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.030913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4ffa8aeb-6409-44da-a7f8-7d59b5ef032c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1281 microversion: 2.20 time: 0.069878 Jul 20 19:33:55.031464 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 456/915] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:54 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:55.768414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:55.769120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:55.775917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.776371 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.777181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:55.777860 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:55.910358 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:55.919130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4d45d668-b17d-4edd-b108-3347697b75ed tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.154675 Jul 20 19:33:55.919694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 460/916] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:55 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:56.049650 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:56.050293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:56.057130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.057586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.058359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.059559 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.136178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.144670 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.147397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:56.148630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-75b3879f-fa71-4596-8c64-cca7ebc268c8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1341 microversion: 2.20 time: 0.103016 Jul 20 19:33:56.149510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 457/917] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:56 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1341 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:33:56.936847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:56.937289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:56.944128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.944574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:56.945451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:56.945885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:57.136159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:57.146058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-833e934d-a004-4c9b-bf2a-b7c0664b4e90 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.213902 Jul 20 19:33:57.146720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 461/918] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:56 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:57.167927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:57.168638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:57.175822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:57.176267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:57.177062 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:57.177494 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:57.427575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:57.436245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:57.438135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:57.439311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-01c4b2e4-d539-43ba-b0fb-ff261c5b95a5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.275369 Jul 20 19:33:57.450263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 458/919] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:57 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:57.803897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-f78ecfdd-e800-4fab-9a76-6b25abff6cd0 req-14f411d9-698a-439a-96d5-feefd6a08115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:57.814353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-f78ecfdd-e800-4fab-9a76-6b25abff6cd0 req-14f411d9-698a-439a-96d5-feefd6a08115 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:57.814807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-f78ecfdd-e800-4fab-9a76-6b25abff6cd0 req-14f411d9-698a-439a-96d5-feefd6a08115 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:57.828654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-f78ecfdd-e800-4fab-9a76-6b25abff6cd0 req-14f411d9-698a-439a-96d5-feefd6a08115 service nova] Creating event network-changed:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:33:57.833713 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-f78ecfdd-e800-4fab-9a76-6b25abff6cd0 req-14f411d9-698a-439a-96d5-feefd6a08115 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033710 Jul 20 19:33:57.834648 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 462/920] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:58.163917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:58.164555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:58.171099 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.171703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.172308 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.172751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.370645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.379382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f301eda0-aef1-480b-9df5-d9440252c875 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.219691 Jul 20 19:33:58.379954 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 459/921] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:58 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:58.459169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:58.459797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:58.466741 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.467197 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.467982 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:58.468427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:58.600396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.608933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.610436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:58.611526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8211176a-1a68-4363-ad85-f4b76e8c3bdc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.157323 Jul 20 19:33:58.612081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 463/922] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:58 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:33:59.397432 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:59.397979 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:59.405995 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.406477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.407257 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.407695 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.573368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.581733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-967b8a2b-007d-4c95-bebc-269ed641ae5f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.188256 Jul 20 19:33:59.582385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 460/923] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:59 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:59.630102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:59.630743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:59.638258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.638716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.639500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:59.639994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:59.872143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.880237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.881784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:59.882888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b9e3003e-56cc-4ef5-8927-0ebc2b40f4e9 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.256701 Jul 20 19:33:59.883446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 464/924] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:33:59 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:00.601112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:00.601732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:00.609955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.610400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.611180 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.611614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.749140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:00.757204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5bd7ce29-fb0a-4cf6-bc7f-4c1374178c48 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.161134 Jul 20 19:34:00.757767 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 461/925] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:00 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:00.901010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:00.901629 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:00.908973 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.909429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:00.910206 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:00.910652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.044959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.052847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.055492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7e5c070d-35e1-4203-8133-f1c202ca4975 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.158428 Jul 20 19:34:01.056052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 465/926] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:00 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:01.773645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:01.774215 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:01.781539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.781981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.782737 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:01.783167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:01.919236 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:01.927573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a7971ea0-139f-4e60-a327-fd80466601ea tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.157790 Jul 20 19:34:01.928360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 462/927] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:01 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:02.074859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:02.075520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:02.082068 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.082522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.083288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.083728 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.217045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.225070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.226580 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:02.227676 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-29b01d65-7ffc-475b-91fa-395a08920415 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.157228 Jul 20 19:34:02.228236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 466/928] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:02 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:02.944842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:02.945478 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:02.952202 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.952593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.953391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:02.953827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:02.972462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:03.083977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:03.092480 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cf675ddc-6aee-49f3-810f-548a7e56ce6d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.151506 Jul 20 19:34:03.093078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 463/929] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:02 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:03.245483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:03.246240 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:03.252750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.253252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.254027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.254466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.402555 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:03.404256 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-f3b60e49-7f2b-4ddf-b339-158c88a3b1d9 req-4672aa35-954e-4e8a-8f77-55750a682063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "name": "network-vif-plugged", "status": "completed", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:03.411574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:03.412772 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-f3b60e49-7f2b-4ddf-b339-158c88a3b1d9 req-4672aa35-954e-4e8a-8f77-55750a682063 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:03.413242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-f3b60e49-7f2b-4ddf-b339-158c88a3b1d9 req-4672aa35-954e-4e8a-8f77-55750a682063 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:03.413849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:03.415233 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e334b16c-acf2-4cb1-907e-0191d82e48e1 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.173771 Jul 20 19:34:03.416103 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 467/930] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:03 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:34:03.425833 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-f3b60e49-7f2b-4ddf-b339-158c88a3b1d9 req-4672aa35-954e-4e8a-8f77-55750a682063 service nova] Creating event network-vif-plugged:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:34:03.430726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-f3b60e49-7f2b-4ddf-b339-158c88a3b1d9 req-4672aa35-954e-4e8a-8f77-55750a682063 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109603 Jul 20 19:34:03.431305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 464/931] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:04.110607 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.111222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.117764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.118250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.119028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.119469 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.365091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.366133 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.372679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.373171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.373946 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.374379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.405569 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3c4d74e5-ab6a-4d6b-832e-1643cb2fe67f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045925 Jul 20 19:34:04.406463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 465/932] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:34:04.434724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.435344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.441578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.442035 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.442811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.443283 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.533517 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.542731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-edfea067-7301-4782-830b-27ae28f6fecb tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.436999 Jul 20 19:34:04.543885 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 468/933] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:04.548442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.549003 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.554876 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.555331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.556117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.556557 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.584799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:34:04.596353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.604626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.606461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.607835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-23b56a59-e9ef-4913-8b35-64b82c0624a6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.177094 Jul 20 19:34:04.608396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 466/934] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:04.662514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6c1542e0-2f6c-4486-86b6-c16b457d25e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 204 len: 0 microversion: 2.1 time: 0.117425 Jul 20 19:34:04.663093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 469/935] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:34:04 2022] DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:34:04.671247 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:04.671843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:04.677866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.678321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.679090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:04.679530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:04.814947 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:04.822502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-32d01f41-b129-4b96-8963-5d6385c5c553 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1674 microversion: 2.1 time: 0.155141 Jul 20 19:34:04.823063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 467/936] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:04 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:05.561985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:05.562711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:05.564627 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:05.565315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:05.566477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:05.573435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.573975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.574812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.575263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.625874 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:05.626491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:05.628408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:05.634695 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.635152 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.635963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.636923 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.747047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.755260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4966629c-7e9f-4e40-800b-148026ec5ef2 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1734 microversion: 2.1 time: 0.197484 Jul 20 19:34:05.755843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 470/937] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:05 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:05.795267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.804055 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.805604 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.806715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8c0a4cb9-320f-4e40-8e6b-59d63b0d2e46 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.185377 Jul 20 19:34:05.807281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 468/938] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:05 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:05.840063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:05.841067 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:05.847093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.847545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.848321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:05.848759 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:05.982857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:05.985109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:05.991859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4425f62e-c588-445b-b8d1-4589742692c7 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1674 microversion: 2.1 time: 0.156157 Jul 20 19:34:05.992369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 471/939] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:05 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:06.773392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:06.774097 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:06.781176 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.781634 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.782405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.782846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.826620 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:06.827343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:06.834953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.835482 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.836347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:06.836855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:06.977860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:06.989067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-407ad3b4-7b36-496c-a34d-575de9f22266 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1714 microversion: 2.1 time: 0.219905 Jul 20 19:34:06.989851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 469/940] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:06 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1714 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:07.006451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.010016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.010928 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.020366 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.021827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.021983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.022281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.023041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-91358b6c-facd-4a36-9535-0cb342861846 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1406 microversion: 2.20 time: 0.201142 Jul 20 19:34:07.023158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.023486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.023616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 472/941] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:06 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:07.101479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.101924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.109264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.110327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.111155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.111598 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.165342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.172975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-04eb739e-66d7-4ed3-b846-a6f295b54728 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1674 microversion: 2.1 time: 0.167071 Jul 20 19:34:07.173543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 470/942] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:07 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:07.198230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] HTTP exception thrown: Cannot 'detach_volume' instance 82e10053-0587-4935-910f-04bd301bdfbe while it is in vm_state rescued Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Request method failure captured: Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments/da975c87-24c5-41d4-a8c7-7e403b4e50d1 HTTP/1.1 Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdDbOfeA4XyluI-RwaV8StPT-ddRKYfJoa13j6uQSZWTPND3X5lEIe0ltqd6KfP5Fn3XxQ11acH5XPn0S9y8E91f7eh9WpJrAwNFzLqEZxqpfHK-rjRiOgdD9uWWSNOmuvlFgT6_5VFULdy56eD_Xg4otVlU1qvnf0-ovIJp2zDELU Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:34:07.200574 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9c025843a2de49d48c39b40f2261d3bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 347106fdd7c94624ab9d40b51da78623 Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:34:07.202160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Cannot 'detach_volume' instance 82e10053-0587-4935-910f-04bd301bdfbe while it is in vm_state rescued Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'server_id': '82e10053-0587-4935-910f-04bd301bdfbe', 'id': 'da975c87-24c5-41d4-a8c7-7e403b4e50d1'} Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82e10053-0587-4935-910f-04bd301bdfbe in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:07.202912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 82e10053-0587-4935-910f-04bd301bdfbe while it is in vm_state rescued Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 82e10053-0587-4935-910f-04bd301bdfbe while it is in vm_state rescued Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:07.204397 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Returning 409 to user: Cannot 'detach_volume' instance 82e10053-0587-4935-910f-04bd301bdfbe while it is in vm_state rescued {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:07.205652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b3c726bf-113f-4ef8-935a-a24a94c67795 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments/da975c87-24c5-41d4-a8c7-7e403b4e50d1" status: 409 len: 152 microversion: 2.1 time: 0.104682 Jul 20 19:34:07.205652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 473/943] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:34:07 2022] DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments/da975c87-24c5-41d4-a8c7-7e403b4e50d1 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 19:34:07.211122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:07.211691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.218407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.218861 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.219630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.220066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.288727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b8ad9b56-1a69-4fc1-aaa9-105ece803cf0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/action" status: 202 len: 0 microversion: 2.1 time: 0.081234 Jul 20 19:34:07.289892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 471/944] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:34:07 2022] POST /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:07.297630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:07.298235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.305309 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.305757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.306523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.306957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.449359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:07.457512 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5260b833-b430-43eb-a2a2-5ce32e1ddd0d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1722 microversion: 2.1 time: 0.163712 Jul 20 19:34:07.458116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 474/945] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:07 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:07.926661 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-337459103"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:07.927263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:07.934194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.934633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:07.935391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:07.935816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.042978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.043901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.053881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.054446 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.055613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.056058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.068461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.network.security_group_api [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Removing security group 7a873f5b-f6c0-4459-89e4-8db8857352b6 from port 53beb0fe-5f2d-480b-8bef-611c76c92caf Jul 20 19:34:08.279814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.288821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.290417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.291601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b8944331-5d0d-4e65-80d2-b95119c3ddbc tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1598 microversion: 2.20 time: 0.253141 Jul 20 19:34:08.292164 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 475/946] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1598 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:34:08.297487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.297881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.304204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.304735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.305614 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.306055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.520656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:08.531624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e69ffe67-c6bc-4e9e-84c1-262f4d715240 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1674 microversion: 2.1 time: 0.237588 Jul 20 19:34:08.532214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 476/947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:08.537172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.537657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.544173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.544656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.545463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.545903 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.585401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-16275478-22be-4ed9-896c-1b52934835d4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action" status: 202 len: 0 microversion: 2.1 time: 0.663557 Jul 20 19:34:08.591384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 472/948] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:34:07 2022] POST /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:08.595945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:08.596630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:08.607380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.608277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.609899 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.610998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.674849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a43a6caa-9160-43f6-b9f5-19ed84edcf18 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141525 Jul 20 19:34:08.675461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 477/949] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:34:08.680232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-91dcc3ef-bbd1-4a82-82c3-20a7b1e2095d req-89ec9502-426c-4cc0-a33d-9a48ba279708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:08.700635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-91dcc3ef-bbd1-4a82-82c3-20a7b1e2095d req-89ec9502-426c-4cc0-a33d-9a48ba279708 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:08.701202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-91dcc3ef-bbd1-4a82-82c3-20a7b1e2095d req-89ec9502-426c-4cc0-a33d-9a48ba279708 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:08.723637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-91dcc3ef-bbd1-4a82-82c3-20a7b1e2095d req-89ec9502-426c-4cc0-a33d-9a48ba279708 service nova] Creating event network-changed:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:34:08.748333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-91dcc3ef-bbd1-4a82-82c3-20a7b1e2095d req-89ec9502-426c-4cc0-a33d-9a48ba279708 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071590 Jul 20 19:34:08.748987 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 478/950] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:09.079746 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:09.093887 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8dd41fa5-5e54-416c-9fa3-45779e8c73a1 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1722 microversion: 2.1 time: 0.501019 Jul 20 19:34:09.094693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 473/951] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:08 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:09.550114 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:09.550937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:09.558187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.559232 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:09.560263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:09.560761 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.111994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:10.112609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:10.131613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.132170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.143566 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.144234 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.316917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.325148 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ee9de3de-c816-41cc-aef2-5212e0ed6414 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1674 microversion: 2.1 time: 0.779665 Jul 20 19:34:10.325945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 479/952] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:09 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1674 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:10.340241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:10.341136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:10.348936 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.349323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.350608 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.350825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.449373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lazy-loading 'services' on Instance uuid 534f506f-149d-4ae7-bb63-794c97796305 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:10.530132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-25540e61-a058-4312-b58d-726185060a7a tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments/5aed6b19-bc47-4da9-8f78-26f3087673b9" status: 202 len: 0 microversion: 2.1 time: 0.194344 Jul 20 19:34:10.531699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 480/953] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:34:10 2022] DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments/5aed6b19-bc47-4da9-8f78-26f3087673b9 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:10.540255 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-5e7facef-a185-4239-843d-588f7a2b046f req-8a727393-28e2-414a-bec0-faf6bc8b7520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:10.551230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5e7facef-a185-4239-843d-588f7a2b046f req-8a727393-28e2-414a-bec0-faf6bc8b7520 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.552678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5e7facef-a185-4239-843d-588f7a2b046f req-8a727393-28e2-414a-bec0-faf6bc8b7520 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.566800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-5e7facef-a185-4239-843d-588f7a2b046f req-8a727393-28e2-414a-bec0-faf6bc8b7520 service nova] Creating event network-changed:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:34:10.572246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-5e7facef-a185-4239-843d-588f7a2b046f req-8a727393-28e2-414a-bec0-faf6bc8b7520 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037799 Jul 20 19:34:10.573492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 481/954] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:10.582033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:10.583357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:10.591202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.591795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.592693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:10.593439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:10.626447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2ae911ab-6a48-4aba-986a-75a35cecca5d tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050262 Jul 20 19:34:10.627360 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 482/955] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:10 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:10.671289 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:10.686280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4d5e61da-2e35-4c9c-bbdc-778ea5ce7aef tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1722 microversion: 2.1 time: 0.578017 Jul 20 19:34:10.719566 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 474/956] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:10 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:11.346121 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.346821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.357504 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.358295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.359304 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.359941 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.487217 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.497364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-152b5f96-bb62-4813-9f0b-757a9b0d04da tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1606 microversion: 2.1 time: 0.155692 Jul 20 19:34:11.507677 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 483/957] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1606 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:11.525833 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-1431ec23-9a68-4cf6-be03-4b003f92889c req-b2f351e8-619a-4f0c-a98c-99ba342fa484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05854927-1ff5-4246-9509-c677fbb0a9f2", "name": "network-vif-deleted", "tag": "d840dfba-98a6-425f-b11b-365b0749db34"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:11.537679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-1431ec23-9a68-4cf6-be03-4b003f92889c req-b2f351e8-619a-4f0c-a98c-99ba342fa484 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.538124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-1431ec23-9a68-4cf6-be03-4b003f92889c req-b2f351e8-619a-4f0c-a98c-99ba342fa484 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.550203 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-1431ec23-9a68-4cf6-be03-4b003f92889c req-b2f351e8-619a-4f0c-a98c-99ba342fa484 service nova] Creating event network-vif-deleted:d840dfba-98a6-425f-b11b-365b0749db34 for instance 05854927-1ff5-4246-9509-c677fbb0a9f2 on hv-cinder-85054 Jul 20 19:34:11.555076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-1431ec23-9a68-4cf6-be03-4b003f92889c req-b2f351e8-619a-4f0c-a98c-99ba342fa484 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Jul 20 19:34:11.555680 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 475/958] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:11.641790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.643357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.649733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.650471 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.651758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.653248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.687862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-622d669e-8cf8-439a-b0f9-9b7e694c2222 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051996 Jul 20 19:34:11.688463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 484/959] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:11.724269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:11.725413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:11.732370 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.733151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.734177 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:11.734828 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:11.881487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:11.890438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e1d40e71-508f-4b12-a19b-2f21f562d942 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1722 microversion: 2.1 time: 0.170388 Jul 20 19:34:11.891027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 476/960] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:11 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:12.514792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:12.515411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:12.521615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.522072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.522865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.523305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.595654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:12.605142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-08476438-a1a9-40b6-872d-47a1098e6ea4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1606 microversion: 2.1 time: 0.094521 Jul 20 19:34:12.606118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 485/961] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:12 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:12.702480 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:12.703450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:12.710290 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.710738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.711517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.711956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.744205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-90f64e13-efe5-4a26-88e2-f9a6e33e2bb9 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048341 Jul 20 19:34:12.744764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 477/962] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:12 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:12.907611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:12.908222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:12.915173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.915628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:12.916431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:12.916871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.049927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.057822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b21b44b1-de66-48da-8f55-d2ec8cbf2664 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1722 microversion: 2.1 time: 0.154124 Jul 20 19:34:13.059036 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 486/963] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:12 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:13.570294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-137021f7-973d-4dc3-9451-a4180b756093 req-1fff6066-ad8b-4950-b17b-56b59e93cbcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:13.579584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-137021f7-973d-4dc3-9451-a4180b756093 req-1fff6066-ad8b-4950-b17b-56b59e93cbcb service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.580012 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-137021f7-973d-4dc3-9451-a4180b756093 req-1fff6066-ad8b-4950-b17b-56b59e93cbcb service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.596797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-137021f7-973d-4dc3-9451-a4180b756093 req-1fff6066-ad8b-4950-b17b-56b59e93cbcb service nova] Creating event network-changed:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:34:13.610006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-137021f7-973d-4dc3-9451-a4180b756093 req-1fff6066-ad8b-4950-b17b-56b59e93cbcb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 Jul 20 19:34:13.610873 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 478/964] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:13.622785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.623400 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.630852 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.631418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.632285 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.633280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.666792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.667172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.668214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lazy-loading 'fault' on Instance uuid 05854927-1ff5-4246-9509-c677fbb0a9f2 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:13.709975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:13.718588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a07e69dd-cbb7-4511-8cb1-99d897bae171 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1328 microversion: 2.1 time: 0.100011 Jul 20 19:34:13.719159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 487/965] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:13 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:13.757706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.758703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.765013 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.765458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.766211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.766637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.795549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bdd4b56d-8197-4c92-b3aa-d6f0a2bb171f tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042611 Jul 20 19:34:13.796113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 479/966] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:13 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:34:13.805835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:13.806333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:13.812426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.812873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.813695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:13.814132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:13.888066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] HTTP exception thrown: Instance 534f506f-149d-4ae7-bb63-794c97796305 is not attached to volume 5aed6b19-bc47-4da9-8f78-26f3087673b9 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Request method failure captured: Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments/5aed6b19-bc47-4da9-8f78-26f3087673b9 HTTP/1.1 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fe7BQUgfSryS0zleINpfCWl7Mad98qhe9NKzHkoib5scdImXlsRRvowW1sOgd8wVwAfNKRDFmbxq4MaDa2fz-XlZMRdEh1LzF4iP3CJgWamLmcrpiIYNjO-tEX3TgG3EuB2KUlpci9saWCS7GqQ07uzzswIOchBwq17appmYz5TMPU Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 91e1220a765f41e88d4e3480b9a7a687 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:34:13.893699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_91e1220a765f41e88d4e3480b9a7a687", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 91e1220a765f41e88d4e3480b9a7a687 Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-TestMinimumBasicScenario-2094220601-project Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 43929f4dcce44f3bac9fd69cf960c985 Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-TestMinimumBasicScenario-2094220601-project Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:34:13.895281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 534f506f-149d-4ae7-bb63-794c97796305 is not attached to volume 5aed6b19-bc47-4da9-8f78-26f3087673b9 Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'server_id': '534f506f-149d-4ae7-bb63-794c97796305', 'id': '5aed6b19-bc47-4da9-8f78-26f3087673b9'} Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5aed6b19-bc47-4da9-8f78-26f3087673b9. Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:13.896077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534f506f-149d-4ae7-bb63-794c97796305 is not attached to volume 5aed6b19-bc47-4da9-8f78-26f3087673b9 Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534f506f-149d-4ae7-bb63-794c97796305 is not attached to volume 5aed6b19-bc47-4da9-8f78-26f3087673b9 Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:13.897444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Returning 404 to user: Instance 534f506f-149d-4ae7-bb63-794c97796305 is not attached to volume 5aed6b19-bc47-4da9-8f78-26f3087673b9 {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:13.898570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c128a83a-c3cc-4d93-9f7c-72b788e7edb4 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments/5aed6b19-bc47-4da9-8f78-26f3087673b9" status: 404 len: 154 microversion: 2.1 time: 0.093317 Jul 20 19:34:13.898570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 488/967] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:34:13 2022] DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305/os-volume_attachments/5aed6b19-bc47-4da9-8f78-26f3087673b9 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:34:14.076304 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.076906 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.082865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.083312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.084103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.084567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.213620 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.222299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-63bcde16-a01d-4ba4-b392-ed6cb744b2b5 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1728 microversion: 2.1 time: 0.150564 Jul 20 19:34:14.222865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 480/968] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:14.238509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.239049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.245932 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.246658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.247437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.247875 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.251610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:14.330993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8d7258ba-27ef-4375-b03d-4d6288e9adc7 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096285 Jul 20 19:34:14.331589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 489/969] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:14.736361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:14.737079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:14.743226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.743691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.744523 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.744951 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.765483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:14.781443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:14.781898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:14.782354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lazy-loading 'fault' on Instance uuid 05854927-1ff5-4246-9509-c677fbb0a9f2 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:14.858886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:14.868864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-320ed225-eed3-4032-8b4a-d1d9ad7d4554 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 200 len: 1328 microversion: 2.1 time: 0.136293 Jul 20 19:34:14.870171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 481/970] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:14 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:15.029317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.029847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.036866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.037351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.038182 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.038636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.065623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:34:15.151432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-77b27038-7bd7-43bf-bb15-21848fb1f308 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 204 len: 0 microversion: 2.1 time: 0.126608 Jul 20 19:34:15.152983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 490/971] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:34:15 2022] DELETE /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:34:15.161687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.162301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.171002 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.171002 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.171351 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.171546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.498673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:15.507102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0f6db6b1-c9a2-4ebd-ac22-19c612a25359 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1554 microversion: 2.1 time: 0.349579 Jul 20 19:34:15.507796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 482/972] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1554 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:15.736017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-6c3a652d-b0c8-4f3c-b9db-d45ffd1164b7 req-3a18fa51-daae-41c2-bbcf-e82fa13a8cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:15.744718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-6c3a652d-b0c8-4f3c-b9db-d45ffd1164b7 req-3a18fa51-daae-41c2-bbcf-e82fa13a8cf7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.745224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-6c3a652d-b0c8-4f3c-b9db-d45ffd1164b7 req-3a18fa51-daae-41c2-bbcf-e82fa13a8cf7 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.758173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-6c3a652d-b0c8-4f3c-b9db-d45ffd1164b7 req-3a18fa51-daae-41c2-bbcf-e82fa13a8cf7 service nova] Creating event network-changed:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:34:15.763712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-6c3a652d-b0c8-4f3c-b9db-d45ffd1164b7 req-3a18fa51-daae-41c2-bbcf-e82fa13a8cf7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031858 Jul 20 19:34:15.764314 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 491/973] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:15.887708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.888240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.895025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.895477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.896255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.896693 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.911084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 HTTP/1.1 Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:34:15.913171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:34:15.914533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '05854927-1ff5-4246-9509-c677fbb0a9f2'} Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:15.915846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:34:15.917384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:34:15.918842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:15.918842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e5bbdbfa-b49d-4847-aefe-ed3751b63773 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 404 len: 111 microversion: 2.1 time: 0.031465 Jul 20 19:34:15.918842 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 483/974] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:34:15.924415 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2b78cf97-8208-47b8-b963-894abd163f50 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '.version_select at 0x7f0e85b83af0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.927651 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b78cf97-8208-47b8-b963-894abd163f50 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [cb49b8b4-b510-43ee-887c-f53094333ee2] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:34:16.525137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:16.525758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:16.532925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.533378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.534189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:16.534631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:16.671787 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:16.679297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bb8e49a8-5278-4086-a990-1e0275a00823 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1554 microversion: 2.1 time: 0.158157 Jul 20 19:34:16.679856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 484/975] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:16 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:16.935490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b78cf97-8208-47b8-b963-894abd163f50 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [cb49b8b4-b510-43ee-887c-f53094333ee2] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33176. Jul 20 19:34:16.954858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2b78cf97-8208-47b8-b963-894abd163f50 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275749067" status: 202 len: 0 microversion: 2.1 time: 1.034661 Jul 20 19:34:16.955449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 492/976] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 19:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275749067 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:17.696412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:17.697069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:17.706181 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.706635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.707423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.707864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.784816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-39249cf0-3c5f-4736-bf58-e49c3f0ba44e req-5d8a4fa4-9905-42d4-b2b7-6cbd4082024b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:17.795369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-39249cf0-3c5f-4736-bf58-e49c3f0ba44e req-5d8a4fa4-9905-42d4-b2b7-6cbd4082024b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.795823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-39249cf0-3c5f-4736-bf58-e49c3f0ba44e req-5d8a4fa4-9905-42d4-b2b7-6cbd4082024b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.811359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-39249cf0-3c5f-4736-bf58-e49c3f0ba44e req-5d8a4fa4-9905-42d4-b2b7-6cbd4082024b service nova] Creating event network-changed:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:34:17.816513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-39249cf0-3c5f-4736-bf58-e49c3f0ba44e req-5d8a4fa4-9905-42d4-b2b7-6cbd4082024b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036275 Jul 20 19:34:17.817237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 493/977] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:17.935162 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dfe2372f-8f10-4c82-a320-b02dbdb19fcc tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: .version_select at 0x7f0e85d5bca0>, body: {"keypair": {"name": "tempest-keypair-343983805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiGnL9dTMleUit6nIIDZMiyJ7j5GROGpg+8569Whq+jgjN0S/vdmEepXEtGuPA21cpiSeXqrM2Jg0o3UCtE7C5wHtDL7GxugKSnAFYxxO+pzA5cRsyhoU3RG5vdLlmHEg=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:17.949505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-dfe2372f-8f10-4c82-a320-b02dbdb19fcc tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:34:17.953899 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-dfe2372f-8f10-4c82-a320-b02dbdb19fcc tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for user 3f7758d298f642138b71aa422d0344da and project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:34:17.978417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dfe2372f-8f10-4c82-a320-b02dbdb19fcc tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048169 Jul 20 19:34:17.980670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 494/978] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:34:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:18.052287 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:18.061617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ccbd02b1-ca5c-4a6e-9d5f-43968848fe69 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1554 microversion: 2.1 time: 0.369736 Jul 20 19:34:18.062225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 485/979] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:17 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1554 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:19.079552 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:19.080291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:19.086631 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.087193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.087974 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.088406 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.121575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.122026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.122483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lazy-loading 'fault' on Instance uuid 534f506f-149d-4ae7-bb63-794c97796305 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:19.190625 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43929f4dcce44f3bac9fd69cf960c985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91e1220a765f41e88d4e3480b9a7a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:19.202786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-21ba536e-aec6-44c3-a7e7-7765df6947b6 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 200 len: 1349 microversion: 2.1 time: 0.127738 Jul 20 19:34:19.205668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 495/980] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:19 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:19.688545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-229710748", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f233501-5abf-42f7-9923-d5c098fbf3c6"}], "security_groups": [{"name": "tempest-securitygroup--1901843524"}], "key_name": "tempest-keypair-343983805", "user_data": "}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:19.790973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] validate_networks() for [('1f233501-5abf-42f7-9923-d5c098fbf3c6', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:34:19.840007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-5168d427-cbc3-4eb7-87be-a1bbdb4f1ec7 req-61b9ac7f-ed01-4e0b-91d5-68ecc730bd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534f506f-149d-4ae7-bb63-794c97796305", "name": "network-vif-deleted", "tag": "53beb0fe-5f2d-480b-8bef-611c76c92caf"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:19.848167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5168d427-cbc3-4eb7-87be-a1bbdb4f1ec7 req-61b9ac7f-ed01-4e0b-91d5-68ecc730bd44 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:19.848618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5168d427-cbc3-4eb7-87be-a1bbdb4f1ec7 req-61b9ac7f-ed01-4e0b-91d5-68ecc730bd44 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:19.860275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-5168d427-cbc3-4eb7-87be-a1bbdb4f1ec7 req-61b9ac7f-ed01-4e0b-91d5-68ecc730bd44 service nova] Creating event network-vif-deleted:53beb0fe-5f2d-480b-8bef-611c76c92caf for instance 534f506f-149d-4ae7-bb63-794c97796305 on hv-cinder-85054 Jul 20 19:34:19.865144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-5168d427-cbc3-4eb7-87be-a1bbdb4f1ec7 req-61b9ac7f-ed01-4e0b-91d5-68ecc730bd44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029006 Jul 20 19:34:19.865754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 496/981] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:20.162985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:34:20.163417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:34:20.163895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:34:20.164303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:34:20.164758 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:34:20.174536 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.174986 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.175788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.176229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.193349 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:34:20.197347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Getting quotas for user 3f7758d298f642138b71aa422d0344da and project 02f994a0231b4176b8181d13d58ee9ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:34:20.208393 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:34:20.210655 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:34:20.222172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.222947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] [instance: 534f506f-149d-4ae7-bb63-794c97796305] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.229560 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.230079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.231521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.231963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.246522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] HTTP exception thrown: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Request method failure captured: Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 HTTP/1.1 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fe7BQUgfSryS0zleINpfCWl7Mad98qhe9NKzHkoib5scdImXlsRRvowW1sOgd8wVwAfNKRDFmbxq4MaDa2fz-XlZMRdEh1LzF4iP3CJgWamLmcrpiIYNjO-tEX3TgG3EuB2KUlpci9saWCS7GqQ07uzzswIOchBwq17appmYz5TMPU Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 91e1220a765f41e88d4e3480b9a7a687 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:34:20.247984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_91e1220a765f41e88d4e3480b9a7a687", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/91e1220a765f41e88d4e3480b9a7a687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 91e1220a765f41e88d4e3480b9a7a687 Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2094220601 Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-TestMinimumBasicScenario-2094220601-project Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 43929f4dcce44f3bac9fd69cf960c985 Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-TestMinimumBasicScenario-2094220601-project Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. Jul 20 19:34:20.249658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '534f506f-149d-4ae7-bb63-794c97796305'} Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:20.250443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. Jul 20 19:34:20.251626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:34:20.252720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Returning 404 to user: Instance 534f506f-149d-4ae7-bb63-794c97796305 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:20.252720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-55466d33-9e23-487f-9e4b-58cfa5e92219 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305" status: 404 len: 111 microversion: 2.1 time: 0.031916 Jul 20 19:34:20.252720 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 497/982] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/534f506f-149d-4ae7-bb63-794c97796305 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:34:20.257881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b45e8cc3-005d-49cb-8dd9-6bf8dcb69922 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] Calling method '.version_select at 0x7f0e85dfbaf0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.259508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8987ee44-e209-494e-b278-9c3c51b055b1 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575275 Jul 20 19:34:20.260298 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 486/983] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:34:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:34:20.269855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-36610032-ff72-4e20-8052-01ca3a2e5421 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.270473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-36610032-ff72-4e20-8052-01ca3a2e5421 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.275569 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b45e8cc3-005d-49cb-8dd9-6bf8dcb69922 tempest-TestMinimumBasicScenario-2094220601 tempest-TestMinimumBasicScenario-2094220601-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1004681381" status: 202 len: 0 microversion: 2.1 time: 0.021062 Jul 20 19:34:20.276552 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 498/984] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 19:34:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1004681381 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:20.341479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-36610032-ff72-4e20-8052-01ca3a2e5421 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:20.349699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-36610032-ff72-4e20-8052-01ca3a2e5421 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1236 microversion: 2.1 time: 0.083565 Jul 20 19:34:20.350324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 487/985] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:21.368489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:21.369346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:21.377187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.377707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.378561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:21.379027 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:21.491186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:21.502827 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-72dbe1c8-4073-4efc-b506-b23a25d4cbe4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1296 microversion: 2.1 time: 0.139040 Jul 20 19:34:21.503851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 499/986] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:21 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:22.519743 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:22.521160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:22.529165 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.529909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.531278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.531976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.736331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.744058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-59826856-9714-460b-80a8-d25fcf86a823 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.228249 Jul 20 19:34:22.744619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 488/987] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:22 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:23.077960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-a8b19f0e-bfb2-4f8b-b660-caabf6f8a4b2 req-ee4bd339-9eaf-45e8-818e-d638d28a2a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324db5cc-5507-42f6-8814-856da9645d90", "tag": "e7b6841e-bfd1-409d-8c32-4732c85f1421"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:23.100000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-a8b19f0e-bfb2-4f8b-b660-caabf6f8a4b2 req-ee4bd339-9eaf-45e8-818e-d638d28a2a81 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.103861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-a8b19f0e-bfb2-4f8b-b660-caabf6f8a4b2 req-ee4bd339-9eaf-45e8-818e-d638d28a2a81 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.132688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-a8b19f0e-bfb2-4f8b-b660-caabf6f8a4b2 req-ee4bd339-9eaf-45e8-818e-d638d28a2a81 service nova] Creating event network-changed:e7b6841e-bfd1-409d-8c32-4732c85f1421 for instance 324db5cc-5507-42f6-8814-856da9645d90 on hv-cinder-85054 Jul 20 19:34:23.141870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-a8b19f0e-bfb2-4f8b-b660-caabf6f8a4b2 req-ee4bd339-9eaf-45e8-818e-d638d28a2a81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068370 Jul 20 19:34:23.145577 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 500/988] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:23.761957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:23.762591 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:23.769117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.769570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.770359 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.770801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.983343 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.991076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d8658ad2-f924-4736-99f4-5e7e00ccc53e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.232938 Jul 20 19:34:24.000677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 489/989] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:23 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:25.016851 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.020796 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.032666 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.033409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.034281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.034800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.286931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.297519 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f5ca7a61-ee70-490f-9fb5-ba806e09bdea tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.293000 Jul 20 19:34:25.298225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 501/990] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:25 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:26.321893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.322502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.325790 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:26.331173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.331619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.332394 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.332826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.507064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.517018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d6e52c42-82b3-4be5-bef4-1e4df3bbc2b4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.198983 Jul 20 19:34:26.517708 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 490/991] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:27.536771 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.537440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.544865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.545724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.546688 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.547291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.772492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.780646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2c5614b8-fe4a-43bf-aa4b-92da740561e4 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.249927 Jul 20 19:34:27.781458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 502/992] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:28.798654 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:28.799322 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:28.806362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.806803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.808278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.808561 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.960178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:28.968327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2618ef1e-9eb2-42e4-8785-6fda4ecee275 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.174150 Jul 20 19:34:28.969023 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 491/993] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:28 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:29.517334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-9f7cd612-8968-4506-852c-4f6baf975e85 req-f0afd61b-e614-4700-a53e-56a7d9d0d3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324db5cc-5507-42f6-8814-856da9645d90", "name": "network-vif-plugged", "status": "completed", "tag": "e7b6841e-bfd1-409d-8c32-4732c85f1421"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:29.525566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=4 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:29.529345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9f7cd612-8968-4506-852c-4f6baf975e85 req-f0afd61b-e614-4700-a53e-56a7d9d0d3d8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.529897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9f7cd612-8968-4506-852c-4f6baf975e85 req-f0afd61b-e614-4700-a53e-56a7d9d0d3d8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.545455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-9f7cd612-8968-4506-852c-4f6baf975e85 req-f0afd61b-e614-4700-a53e-56a7d9d0d3d8 service nova] Creating event network-vif-plugged:e7b6841e-bfd1-409d-8c32-4732c85f1421 for instance 324db5cc-5507-42f6-8814-856da9645d90 on hv-cinder-85054 Jul 20 19:34:29.551411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-9f7cd612-8968-4506-852c-4f6baf975e85 req-f0afd61b-e614-4700-a53e-56a7d9d0d3d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Jul 20 19:34:29.552052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 503/994] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:29.987611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:29.988579 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:29.996631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.997482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.998435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.998883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.128053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.135527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f4510f0b-6db2-41ec-9bb1-3a0999b4aaeb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.153687 Jul 20 19:34:30.136630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 492/995] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:29 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:31.154136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:31.154831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:31.161062 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.161512 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.162524 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.162959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.295301 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.302727 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-61df00a3-0039-4343-9155-3ad286e8dba9 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1362 microversion: 2.1 time: 0.153947 Jul 20 19:34:31.303292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 504/996] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:31 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.318993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.319589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.321490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:32.322775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=8 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:32.329128 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.329578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.330347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.330780 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.459126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.467167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c5b08e5b-65bd-4184-aba2-a95401262d84 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1548 microversion: 2.1 time: 0.152079 Jul 20 19:34:32.467741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 493/997] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.483683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.484186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.490411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.490870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.491650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.492093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.572819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d25862bb-5746-4002-bed0-0dac5ecf442d tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093394 Jul 20 19:34:32.573705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 505/998] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:33.506894 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-6d3b9a88-01f9-44ce-b66a-01f8ffa6345a req-06e5d988-91b1-43fd-b018-3cb81f4760f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324db5cc-5507-42f6-8814-856da9645d90", "tag": "e7b6841e-bfd1-409d-8c32-4732c85f1421"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:33.516030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6d3b9a88-01f9-44ce-b66a-01f8ffa6345a req-06e5d988-91b1-43fd-b018-3cb81f4760f3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.516466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6d3b9a88-01f9-44ce-b66a-01f8ffa6345a req-06e5d988-91b1-43fd-b018-3cb81f4760f3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.528227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-6d3b9a88-01f9-44ce-b66a-01f8ffa6345a req-06e5d988-91b1-43fd-b018-3cb81f4760f3 service nova] Creating event network-changed:e7b6841e-bfd1-409d-8c32-4732c85f1421 for instance 324db5cc-5507-42f6-8814-856da9645d90 on hv-cinder-85054 Jul 20 19:34:33.533791 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-6d3b9a88-01f9-44ce-b66a-01f8ffa6345a req-06e5d988-91b1-43fd-b018-3cb81f4760f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031601 Jul 20 19:34:33.534531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 494/999] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:58.577329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:58.578281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:58.582775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:58.583278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:58.591597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.592057 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.592834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:58.593819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:58.620028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2a190aa7-96f3-494b-9356-ef74a2bbc7f2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/ips" status: 200 len: 152 microversion: 2.20 time: 0.044366 Jul 20 19:34:58.620606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 506/1000] 10.222.0.79 () {60 vars in 1288 bytes} [Wed Jul 20 19:34:58 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:35:01.389812 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:01.391001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:01.393221 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=9 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:01.394064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=64 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:01.402416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.402876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.403658 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.404098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.429402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lazy-loading 'flavor' on Instance uuid 0c72290e-2e8d-4d75-bc12-044982fde7e4 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:01.755857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cb519f70-54b2-481a-bf01-fd4c56cd5610 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/action" status: 202 len: 0 microversion: 2.20 time: 0.370491 Jul 20 19:35:01.756490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 495/1001] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 19:35:01 2022] POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:35:01.764492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:01.765684 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:01.772801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.773288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.774072 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:01.774772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:01.914319 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:01.925313 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:01.926862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:01.928047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a3c3c2aa-8cf8-4713-917e-6df1aa2f94a4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.167434 Jul 20 19:35:01.928618 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 507/1002] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:01 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:02.947928 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:02.948635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:02.955357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.955716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:02.956504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:02.956971 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:03.091997 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.100645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.102176 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:03.103319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1e090262-a582-4cdc-bc15-d85fc57743f7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.160623 Jul 20 19:35:03.103917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 496/1003] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:02 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:04.126133 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:04.126783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:04.133448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.133971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.134960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:04.135466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:04.273274 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.282797 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.284299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:04.285500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-10da4089-cb75-4364-afda-80c6418e1679 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.164226 Jul 20 19:35:04.286060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 508/1004] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:04 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:05.304396 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:05.305015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:05.311791 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.312676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.313868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:05.314318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:05.454589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.464043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.465631 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:05.467151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-622c9178-d270-40b7-b032-89bc58271a15 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.167191 Jul 20 19:35:05.467863 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 497/1005] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:05 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:06.487267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.487874 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.494628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.495086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.495877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.496341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.636575 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.644950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.646465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:06.648200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4ca732e0-9f3e-4632-81c1-ba631d08cd0f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.164917 Jul 20 19:35:06.648770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 509/1006] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:06 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:06.676960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.677563 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.684120 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.684567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.685367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.685793 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.775039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lazy-loading 'services' on Instance uuid 82e10053-0587-4935-910f-04bd301bdfbe {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:06.855426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-72a29f9a-22c4-4ae9-88d4-dd06cec8f444 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments/da975c87-24c5-41d4-a8c7-7e403b4e50d1" status: 202 len: 0 microversion: 2.1 time: 0.182337 Jul 20 19:35:06.856020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 498/1007] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:35:06 2022] DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments/da975c87-24c5-41d4-a8c7-7e403b4e50d1 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:06.865006 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:06.865942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:06.873170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.873634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.874430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:06.874879 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:06.907631 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-08fe1581-b77a-4071-89dd-59ed1167ec7d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Jul 20 19:35:06.908215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 510/1008] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:06 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:07.667617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:07.668241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:07.675090 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.675550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.676331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.676773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.823901 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.833165 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.834676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:07.835838 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-28e34662-7498-4f2f-a461-96dbcc045a60 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.172694 Jul 20 19:35:07.836397 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 499/1009] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:07 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:07.920382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:07.921831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:07.928461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.928945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.929731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:07.930170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:07.960307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-018a0eba-c405-4a2b-a065-1bbd0acd5357 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jul 20 19:35:07.960868 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 511/1010] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:07 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:08.854728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:08.855366 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:08.862935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.863380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.864145 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.864586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.972408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:08.973374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:08.980160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.980616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:08.981455 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:08.981898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.004898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.011305 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9fcc662e-47af-4fc5-8a97-2dee74a77a2a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043536 Jul 20 19:35:09.011877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 512/1011] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:08 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 19:35:09.013546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.015414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.016687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d7bfe024-3c98-40d6-8d6f-8e2aa842c1f6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.165860 Jul 20 19:35:09.027005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 500/1012] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:08 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:09.086283 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:09.086786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:09.092870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.093952 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.094760 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.095203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.120021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:35:09.197565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c09e67b3-f610-4bdd-8956-eea9e824e866 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 204 len: 0 microversion: 2.1 time: 0.114841 Jul 20 19:35:09.198423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 513/1013] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:09 2022] DELETE /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:35:09.206717 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:09.207348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:09.213407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.213858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.214635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:09.215080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:09.350502 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:09.358249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-167e5152-941b-41e9-ba2d-da65ff3afc23 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1688 microversion: 2.1 time: 0.155770 Jul 20 19:35:09.358851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 501/1014] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:09 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:10.036045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:10.036749 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:10.043463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.043909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.044672 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.045275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.174489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.182481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.184030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.185220 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b9d0c6bb-3ef9-4514-8765-42a3b9ba0d20 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.154204 Jul 20 19:35:10.185783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 514/1015] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:10 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:10.376016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:10.376556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:10.383094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.383548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.384312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:10.384751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:10.513440 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:10.521644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-86800fe6-751c-4e48-8454-a789584e3e4a tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1688 microversion: 2.1 time: 0.150166 Jul 20 19:35:10.522080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 502/1016] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:10 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:11.203692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:11.204339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:11.210875 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.211333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.212112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.212556 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.345815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.353729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.355246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.356405 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6afdb67b-01b7-4694-914b-64eb2c772154 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.156733 Jul 20 19:35:11.356983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 515/1017] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:11 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:11.538775 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:11.539382 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:11.546744 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.547326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.548114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:11.548548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:11.679448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:11.687519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-abcc0530-71db-4aeb-8faa-69401cc910a0 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1688 microversion: 2.1 time: 0.152366 Jul 20 19:35:11.689231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 503/1018] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:11 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:12.375154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:12.375791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:12.382386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.382844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.383616 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.384055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.518462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.526447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.527967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.529154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e95ca537-22d9-4316-a6cb-1f6b43ef0e7a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.158042 Jul 20 19:35:12.529716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 516/1019] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:12 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:12.706372 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:12.706989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:12.713527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.713982 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.714752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:12.715214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:12.847548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:12.855000 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e6cdc165-46fc-480a-8ae9-0bfe5836803b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1688 microversion: 2.1 time: 0.153268 Jul 20 19:35:12.855608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 504/1020] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:12 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:13.549122 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:13.549737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:13.556370 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.556824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.557642 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.558084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.699658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.708532 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.710081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:13.711246 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-5ff5ec1d-ae23-48c2-a49d-03d958c6f6b8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.167574 Jul 20 19:35:13.711814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 517/1021] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:13 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:13.871565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:13.872521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:13.878740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.879183 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.879945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.880374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.954017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-1d79a040-c410-4a23-a58b-fdc631015793 req-800c7c9f-2386-4f54-93c1-aefb79b27122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e10053-0587-4935-910f-04bd301bdfbe", "name": "network-vif-deleted", "tag": "35b5da22-b362-4b46-8e92-4a5d8c7ec405"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:13.965219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-1d79a040-c410-4a23-a58b-fdc631015793 req-800c7c9f-2386-4f54-93c1-aefb79b27122 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:13.966041 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-1d79a040-c410-4a23-a58b-fdc631015793 req-800c7c9f-2386-4f54-93c1-aefb79b27122 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:13.979775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-1d79a040-c410-4a23-a58b-fdc631015793 req-800c7c9f-2386-4f54-93c1-aefb79b27122 service nova] Creating event network-vif-deleted:35b5da22-b362-4b46-8e92-4a5d8c7ec405 for instance 82e10053-0587-4935-910f-04bd301bdfbe on hv-cinder-85054 Jul 20 19:35:13.985177 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-1d79a040-c410-4a23-a58b-fdc631015793 req-800c7c9f-2386-4f54-93c1-aefb79b27122 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035825 Jul 20 19:35:13.986110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 518/1022] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:14.242945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.251964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-709369f2-2c6d-4131-bbac-a1a4be5f560e tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 200 len: 1621 microversion: 2.1 time: 0.384036 Jul 20 19:35:14.252895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 505/1023] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:13 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 1621 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:14.731781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:14.732543 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:14.739717 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.740174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.740976 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:14.741422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:14.884216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.893456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.895886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:14.897365 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-37b2005a-8441-43d6-9b8b-4b205c33e397 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.170714 Jul 20 19:35:14.898116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 519/1024] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:14 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:15.270326 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.270937 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 82e10053-0587-4935-910f-04bd301bdfbe] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:15.277384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.277833 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.278644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.279074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.293188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] HTTP exception thrown: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Request method failure captured: Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe HTTP/1.1 Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdDbOfeA4XyluI-RwaV8StPT-ddRKYfJoa13j6uQSZWTPND3X5lEIe0ltqd6KfP5Fn3XxQ11acH5XPn0S9y8E91f7eh9WpJrAwNFzLqEZxqpfHK-rjRiOgdD9uWWSNOmuvlFgT6_5VFULdy56eD_Xg4otVlU1qvnf0-ovIJp2zDELU Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:35:15.294808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9c025843a2de49d48c39b40f2261d3bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 347106fdd7c94624ab9d40b51da78623 Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. Jul 20 19:35:15.296596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '82e10053-0587-4935-910f-04bd301bdfbe'} Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:15.297633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. Jul 20 19:35:15.299218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:15.300710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Returning 404 to user: Instance 82e10053-0587-4935-910f-04bd301bdfbe could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:15.300710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bfa1243c-1dd3-4ed0-b85f-019ac010cfb3 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 20 19:35:15.300710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 506/1025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:15 2022] GET /compute/v2.1/servers/82e10053-0587-4935-910f-04bd301bdfbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:15.304947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a591c825-102e-4f5d-ac61-5826bc3a319b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '.version_select at 0x7f0e85dfb310>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.321866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a591c825-102e-4f5d-ac61-5826bc3a319b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664342980" status: 202 len: 0 microversion: 2.1 time: 0.020803 Jul 20 19:35:15.322417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 520/1026] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 19:35:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664342980 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:15.915688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:15.916303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:15.923014 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.923465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:15.924646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:15.925104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:16.065638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.073616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.075194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:16.076304 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-830a5be1-7a68-4c09-b174-d9c32ea03cb5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.164646 Jul 20 19:35:16.077140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 507/1027] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:15 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:17.098217 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:17.098906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:17.105361 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.105906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.106756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:17.107196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:17.241082 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.249069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.251424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:17.252583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-21d8e175-f121-4bb3-b32e-39005c211622 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.160921 Jul 20 19:35:17.253192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 521/1028] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:17 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:18.195626 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:18.196148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:18.202816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.203272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.204583 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.205068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.229945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:35:18.255859 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:18.271848 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:18.272457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:18.279381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.279835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.280607 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.281116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.312442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-734613d3-8364-48f9-8635-8f0b7418c94d tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 204 len: 0 microversion: 2.1 time: 0.120330 Jul 20 19:35:18.313293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 508/1029] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:18 2022] DELETE /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:35:18.321979 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:18.322638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:18.328662 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.329709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.330613 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:18.331045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:18.473704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.477355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:18.483077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.484603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.485979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cc26c030-26ba-49d1-a249-97e2347c517a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1744 microversion: 2.20 time: 0.218336 Jul 20 19:35:18.486692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 522/1030] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:18 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:18.495262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:18.502808 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2c685ddd-71b7-4586-b989-e54169d93147 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1506 microversion: 2.1 time: 0.185560 Jul 20 19:35:18.503371 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 509/1031] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:18 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:19.504514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:19.505268 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:19.512860 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.513334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.514110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.514545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.519792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:19.520428 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:19.527347 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.528201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.529206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:19.529810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:19.723751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.740174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.747468 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e77248b1-a5ea-4425-b7fa-49a294aa6aa8 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 200 len: 1506 microversion: 2.1 time: 0.231676 Jul 20 19:35:19.748623 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 510/1032] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:19 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:19.750500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.752101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:19.753435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-499e4130-227f-442e-be77-917685d9a281 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1744 microversion: 2.20 time: 0.252845 Jul 20 19:35:19.760971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 523/1033] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:19 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:20.021773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-45342cc0-4d89-4724-8aca-dcf249803788 req-e278de56-3b9f-4edf-b187-9d58abf85015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a52396-c000-4931-8896-46dcf99d449a", "name": "network-vif-deleted", "tag": "a6b0ac08-0caa-47dc-9d21-4afca1983d3b"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:20.030235 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-45342cc0-4d89-4724-8aca-dcf249803788 req-e278de56-3b9f-4edf-b187-9d58abf85015 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.030727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-45342cc0-4d89-4724-8aca-dcf249803788 req-e278de56-3b9f-4edf-b187-9d58abf85015 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.042726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-45342cc0-4d89-4724-8aca-dcf249803788 req-e278de56-3b9f-4edf-b187-9d58abf85015 service nova] Creating event network-vif-deleted:a6b0ac08-0caa-47dc-9d21-4afca1983d3b for instance a0a52396-c000-4931-8896-46dcf99d449a on hv-cinder-85054 Jul 20 19:35:20.047517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-45342cc0-4d89-4724-8aca-dcf249803788 req-e278de56-3b9f-4edf-b187-9d58abf85015 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029288 Jul 20 19:35:20.048619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 511/1034] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:20.640447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.641077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.647778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.648238 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.649093 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.649539 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.677597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2c2c218e-8dcd-4fa7-bffa-128b1a5d1a6c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/ips" status: 200 len: 144 microversion: 2.1 time: 0.041034 Jul 20 19:35:20.678186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 524/1035] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:20.765728 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.767061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: a0a52396-c000-4931-8896-46dcf99d449a] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.771076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.771700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.773553 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.774001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.774958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.775389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.777821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.778156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.779144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.779592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.797461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] HTTP exception thrown: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Request method failure captured: Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a HTTP/1.1 Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdDbOfeA4XyluI-RwaV8StPT-ddRKYfJoa13j6uQSZWTPND3X5lEIe0ltqd6KfP5Fn3XxQ11acH5XPn0S9y8E91f7eh9WpJrAwNFzLqEZxqpfHK-rjRiOgdD9uWWSNOmuvlFgT6_5VFULdy56eD_Xg4otVlU1qvnf0-ovIJp2zDELU Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:35:20.801434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9c025843a2de49d48c39b40f2261d3bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 347106fdd7c94624ab9d40b51da78623 Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. Jul 20 19:35:20.803016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'a0a52396-c000-4931-8896-46dcf99d449a'} Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:20.803935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. Jul 20 19:35:20.805866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:35:20.807989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Returning 404 to user: Instance a0a52396-c000-4931-8896-46dcf99d449a could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:20.807989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f58dfb9b-4521-4de3-8f92-ddd29423c451 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a" status: 404 len: 111 microversion: 2.1 time: 0.042368 Jul 20 19:35:20.807989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 512/1036] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/a0a52396-c000-4931-8896-46dcf99d449a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:20.814514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.815400 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.822565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.823021 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.823799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.824233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.856409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:35:20.944546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-616febe8-2f5a-420b-8367-88fecc20125b tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 204 len: 0 microversion: 2.1 time: 0.135876 Jul 20 19:35:20.945841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 513/1037] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:20 2022] DELETE /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:35:20.956079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:20.957912 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:20.966146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.966678 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.967588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:20.968330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:20.980927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.990507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.992687 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:20.993901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ae8fe310-e7b7-45dd-8e32-28b0a3730285 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1744 microversion: 2.20 time: 0.226722 Jul 20 19:35:20.994802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 525/1038] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:21.118611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:21.126220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4780d2f4-8ec2-47f1-a6e7-5e598ba7323f tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.175911 Jul 20 19:35:21.126852 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 514/1039] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:20 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:21.867769 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-69680193-faa6-4519-b997-4e80152b22ce req-6d504378-e4da-4f63-a4c3-a3e317db783d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "name": "network-vif-plugged", "status": "completed", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:21.878923 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-69680193-faa6-4519-b997-4e80152b22ce req-6d504378-e4da-4f63-a4c3-a3e317db783d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:21.879378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-69680193-faa6-4519-b997-4e80152b22ce req-6d504378-e4da-4f63-a4c3-a3e317db783d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:21.892070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-69680193-faa6-4519-b997-4e80152b22ce req-6d504378-e4da-4f63-a4c3-a3e317db783d service nova] Creating event network-vif-plugged:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:35:21.897580 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-69680193-faa6-4519-b997-4e80152b22ce req-6d504378-e4da-4f63-a4c3-a3e317db783d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Jul 20 19:35:21.898174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 526/1040] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:22.013106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:22.013724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.021387 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.021973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.022753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.023185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.144323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:22.145412 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.152428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.152902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.153918 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.154365 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.173369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.182462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.184108 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.185304 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-64bf0edb-c18b-408d-83c3-cbf0cd998410 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1744 microversion: 2.20 time: 0.176465 Jul 20 19:35:22.192819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 515/1041] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:22 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:22.199424 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:22.200487 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.207067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.207446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.208216 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.208649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.293955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:22.301515 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9127633b-e35f-47d9-a26e-54faae575199 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.161716 Jul 20 19:35:22.302098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 527/1042] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:22 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:23.203800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:23.204661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.211234 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.211689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.212462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.212925 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.346069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.354948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.356468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.357664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fd8fe682-d5c5-4c8b-8e70-35f40109061f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1744 microversion: 2.20 time: 0.157926 Jul 20 19:35:23.358226 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 528/1043] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:23 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:23.363579 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:23.364191 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.370128 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.370619 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.371393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.371838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.513201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:23.522403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-db545dd4-1014-4295-b6e0-8778da26dd09 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1521 microversion: 2.1 time: 0.163044 Jul 20 19:35:23.523782 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 529/1044] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:23 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:23.638312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2d40fb3a-1574-4850-8be7-fd15df829874 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.442491 Jul 20 19:35:23.639092 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 516/1045] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:35:22 2022] POST /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 194 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:24.189962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-054fec0a-faeb-45fc-a52a-1433ba0f6c0f req-cffb75ef-3677-436f-8c10-060af319e3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e030ad0-4549-4070-bf06-563e23b2dce5", "name": "network-vif-deleted", "tag": "a2c254e5-f31b-4788-9fa7-0f9ebfad4218"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:24.205689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-054fec0a-faeb-45fc-a52a-1433ba0f6c0f req-cffb75ef-3677-436f-8c10-060af319e3b5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.206275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-054fec0a-faeb-45fc-a52a-1433ba0f6c0f req-cffb75ef-3677-436f-8c10-060af319e3b5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.218180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-054fec0a-faeb-45fc-a52a-1433ba0f6c0f req-cffb75ef-3677-436f-8c10-060af319e3b5 service nova] Creating event network-vif-deleted:a2c254e5-f31b-4788-9fa7-0f9ebfad4218 for instance 0e030ad0-4549-4070-bf06-563e23b2dce5 on hv-cinder-85054 Jul 20 19:35:24.223824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-054fec0a-faeb-45fc-a52a-1433ba0f6c0f req-cffb75ef-3677-436f-8c10-060af319e3b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037540 Jul 20 19:35:24.224367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 530/1046] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:24.378831 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:24.380117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:24.387691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.388622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.389507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.390169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.548865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:24.550112 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:24.561141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.563708 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.564178 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.565174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.565764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.577093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.579089 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.584642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-924770a2-9e1e-4946-9088-6ed3025bfea6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.210959 Jul 20 19:35:24.597460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 517/1047] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:24 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:24.620521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:24.621755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.622778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lazy-loading 'fault' on Instance uuid 0e030ad0-4549-4070-bf06-563e23b2dce5 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:24.680722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347106fdd7c94624ab9d40b51da78623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c025843a2de49d48c39b40f2261d3bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:24.690895 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-649d62ac-bc02-46fa-8acd-7dfd023c82f6 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 200 len: 1312 microversion: 2.1 time: 0.155022 Jul 20 19:35:24.692441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 531/1048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:24 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:25.604497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:25.605115 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:25.612045 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.612723 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.613543 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.613984 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.709842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:25.711200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] [instance: 0e030ad0-4549-4070-bf06-563e23b2dce5] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:25.724649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.725131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.725917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:25.726351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:25.744079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] HTTP exception thrown: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Request method failure captured: Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 HTTP/1.1 Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdDbOfeA4XyluI-RwaV8StPT-ddRKYfJoa13j6uQSZWTPND3X5lEIe0ltqd6KfP5Fn3XxQ11acH5XPn0S9y8E91f7eh9WpJrAwNFzLqEZxqpfHK-rjRiOgdD9uWWSNOmuvlFgT6_5VFULdy56eD_Xg4otVlU1qvnf0-ovIJp2zDELU Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:35:25.745781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9c025843a2de49d48c39b40f2261d3bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9c025843a2de49d48c39b40f2261d3bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 9c025843a2de49d48c39b40f2261d3bf Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040585781 Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 347106fdd7c94624ab9d40b51da78623 Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040585781-project Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. Jul 20 19:35:25.747440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '0e030ad0-4549-4070-bf06-563e23b2dce5'} Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:25.748385 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. Jul 20 19:35:25.750021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:35:25.753601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] Returning 404 to user: Instance 0e030ad0-4549-4070-bf06-563e23b2dce5 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:25.754487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fdba04c3-a896-47cb-ab06-063c8f829ca9 tempest-ServerRescueNegativeTestJSON-2040585781 tempest-ServerRescueNegativeTestJSON-2040585781-project] 10.222.0.79 "GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5" status: 404 len: 111 microversion: 2.1 time: 0.048811 Jul 20 19:35:25.755381 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 532/1049] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:25 2022] GET /compute/v2.1/servers/0e030ad0-4549-4070-bf06-563e23b2dce5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:35:25.776683 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.791046 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.796773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:25.798259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0970c315-21f6-413c-a280-90ce146969d2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.197703 Jul 20 19:35:25.799135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 518/1050] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:25 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:26.818311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:26.819822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:26.828461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.830154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:26.830957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:26.831660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:27.022501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.035686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.037630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:27.038833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-06ab16cf-b05b-4b19-a556-51bcb7ea5e26 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.225735 Jul 20 19:35:27.039722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 533/1051] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:26 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:28.057170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:28.057892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:28.068362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.068807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.069630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:28.070071 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:28.335209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:28.353738 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:28.355330 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:28.356559 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c7db8611-7d89-4e59-b781-972bc14c3a96 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.303455 Jul 20 19:35:28.357154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 519/1052] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:28 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:29.375008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:29.377108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:29.385751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:29.388187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.389016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.390045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:29.390696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:29.584966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.600819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.602423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:29.603696 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f249a660-c20a-4d4c-be04-afb3e650491a tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.232813 Jul 20 19:35:29.604704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 534/1053] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:29 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:30.624668 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:30.626910 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:30.645601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.646855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.648309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:30.649426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:30.865411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.875187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.877258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:30.878747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a72fb6ab-a709-47c4-b8d6-88df3f6e9225 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.259732 Jul 20 19:35:30.879847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 520/1054] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:30 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:31.367944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.368892 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.377498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.378635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.380278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.381419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.460461 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-064439cb-6c8d-4419-80d9-f928aba7850a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096267 Jul 20 19:35:31.462175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 535/1055] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:31.476157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.477418 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.481169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:31.493637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.494436 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.495770 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.496556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.558822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e5a6f6f5-f69d-477c-a132-1f430102cce0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1" status: 200 len: 194 microversion: 2.1 time: 0.089176 Jul 20 19:35:31.568093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 521/1056] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1 => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:31.905311 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.907610 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.915869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.916639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.917660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.918327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.128336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.146776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.152182 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:32.153765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-0ca3beaf-84a6-490e-809c-df87ad0a3fd5 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.252225 Jul 20 19:35:32.157731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 536/1057] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:33.055297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7afbcde1-fd7f-4794-9ad0-ee33ca529ec3"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:33.056437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.064125 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.064577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.065404 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.065845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.175974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:33.187572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.188367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.196787 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.197279 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.198161 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.210509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.417725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.432454 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.434172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.435300 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-73f78894-5685-47b3-a939-1f7598d201c6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.263001 Jul 20 19:35:33.435855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 537/1058] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:33.441520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9d98d656-ed5b-480a-bb85-101fe78268bf tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85e77f70>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.472323 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4f338f41-7b6b-4f51-8a8c-c8908792e8eb tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "POST /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419307 Jul 20 19:35:33.473211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 522/1059] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:35:33 2022] POST /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:33.515541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9d98d656-ed5b-480a-bb85-101fe78268bf tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/4ccc835f-b539-4996-a30e-185e8e0c9ca6" status: 200 len: 351 microversion: 2.1 time: 0.077785 Jul 20 19:35:33.517049 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 538/1060] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/os-volumes/4ccc835f-b539-4996-a30e-185e8e0c9ca6 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:34.456403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.457141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:34.463362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.463809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.464597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.465072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.601324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.609904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.611431 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.612597 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-28196b2e-1fd0-40bf-be4b-f94b048cdb01 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1739 microversion: 2.20 time: 0.161983 Jul 20 19:35:34.613198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 523/1061] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:34.944204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-53fff8db-a0dc-4b91-a428-8cb4e48f0904 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85e38f70>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.990498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-53fff8db-a0dc-4b91-a428-8cb4e48f0904 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1e0166a3-c927-4406-9503-84422ff9020c" status: 200 len: 350 microversion: 2.1 time: 0.050631 Jul 20 19:35:34.991110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 539/1062] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/os-volumes/1e0166a3-c927-4406-9503-84422ff9020c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:35.631721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:35.632968 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:35.639669 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.640209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.641172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.641642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.775305 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.783742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.785286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.786452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5dbb22b8-e223-404c-8925-0cf5340597e3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1721 microversion: 2.20 time: 0.159138 Jul 20 19:35:35.787273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 524/1063] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:35 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:36.333083 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-806edfbd-6317-41c7-a5b7-e6a62ae33f8e tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85e2eee0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.380215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-806edfbd-6317-41c7-a5b7-e6a62ae33f8e tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/57cde64c-5a40-4f8d-b46a-806805354eae" status: 200 len: 351 microversion: 2.1 time: 0.051950 Jul 20 19:35:36.380817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 540/1064] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes/57cde64c-5a40-4f8d-b46a-806805354eae => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:36.392220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9c16b877-e308-48d6-92bc-d4b90dac32f0 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85d10310>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.473065 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9c16b877-e308-48d6-92bc-d4b90dac32f0 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085122 Jul 20 19:35:36.473641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 525/1065] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:36.485603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d4ae2bfa-0599-4b17-8241-f8bd6baec977 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85ffb1f0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.569055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d4ae2bfa-0599-4b17-8241-f8bd6baec977 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087112 Jul 20 19:35:36.569634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 541/1066] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:36.581690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cf095d24-72ab-4394-bb51-8496a27cbe7a tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85dcc3a0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.661155 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cf095d24-72ab-4394-bb51-8496a27cbe7a tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083754 Jul 20 19:35:36.661717 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 526/1067] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:36.673081 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e6573d12-ac1f-485c-9604-d6b58f3e212b tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85b17820>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.753712 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e6573d12-ac1f-485c-9604-d6b58f3e212b tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084428 Jul 20 19:35:36.754299 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 542/1068] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:36.766840 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b00e1f6b-ac64-408f-89dd-e208033f6a79 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e8a4f8dc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.805044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.805592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:36.812384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.812845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.814519 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.814967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.846213 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b00e1f6b-ac64-408f-89dd-e208033f6a79 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083746 Jul 20 19:35:36.846876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 527/1069] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:36.858685 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e84f3fd3-5ff5-4aa4-a480-bf5570bec410 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85ca54c0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.941144 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e84f3fd3-5ff5-4aa4-a480-bf5570bec410 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086056 Jul 20 19:35:36.941731 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 528/1070] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:36.952044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.953244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aae33fdf-2c80-4ed9-8479-73710e29bb63 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85dccaf0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.961038 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.962746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:36.964018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d85d024f-18c5-4532-97b3-e95c0f53af0c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1721 microversion: 2.20 time: 0.162985 Jul 20 19:35:36.964670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 543/1071] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:37.035405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aae33fdf-2c80-4ed9-8479-73710e29bb63 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086318 Jul 20 19:35:37.035987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 529/1072] 10.222.0.79 () {58 vars in 1187 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:37.048269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-985475a5-a739-461d-aff1-9c6debfece21 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] Calling method '.version_select at 0x7f0e85e77f70>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:37.130375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-985475a5-a739-461d-aff1-9c6debfece21 tempest-VolumesTestJSON-1693803200 tempest-VolumesTestJSON-1693803200-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086449 Jul 20 19:35:37.130957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 544/1073] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 19:35:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:37.983206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:37.983754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:37.990060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.990507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:37.991268 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:37.991702 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:38.122566 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.132407 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.133945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:38.135106 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c9d54035-a8d6-4676-be0c-0357351a5cbb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1721 microversion: 2.20 time: 0.156363 Jul 20 19:35:38.135667 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 530/1074] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:37 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:38.568957 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-302a8c7a-0a67-455d-b088-f2c3930be96f req-d12d0728-e874-407e-9c88-bba3c5216012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "name": "network-vif-unplugged", "status": "completed", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:38.579073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-302a8c7a-0a67-455d-b088-f2c3930be96f req-d12d0728-e874-407e-9c88-bba3c5216012 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:38.579521 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-302a8c7a-0a67-455d-b088-f2c3930be96f req-d12d0728-e874-407e-9c88-bba3c5216012 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:38.590129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-302a8c7a-0a67-455d-b088-f2c3930be96f req-d12d0728-e874-407e-9c88-bba3c5216012 service nova] Creating event network-vif-unplugged:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:35:38.595758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-302a8c7a-0a67-455d-b088-f2c3930be96f req-d12d0728-e874-407e-9c88-bba3c5216012 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030772 Jul 20 19:35:38.596501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 545/1075] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:39.154154 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:39.154710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.161943 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.162647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.163415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.163871 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.301574 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.310409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.311929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:39.313187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3f6975b1-d4fc-43b0-a9cf-cede0a9c6394 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1724 microversion: 2.20 time: 0.162956 Jul 20 19:35:39.314104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 531/1076] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:39 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:39.332453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96d7c75-f9a3-4f0d-9491-ff81ad92fd00"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:39.333711 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.340408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.341151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.342160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.342601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.542452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:39.631657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-74d401d3-21c7-4455-92b0-06fb0a9236a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304562 Jul 20 19:35:39.632308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 546/1077] 10.222.0.79 () {62 vars in 1363 bytes} [Wed Jul 20 19:35:39 2022] POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:35:39.751760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:39.752262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.758744 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.759194 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.759972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.760405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.048261 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3db4372e-b13a-4abb-a752-84f7029faa67 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments/d96d7c75-f9a3-4f0d-9491-ff81ad92fd00" status: 202 len: 0 microversion: 2.20 time: 0.300184 Jul 20 19:35:40.049346 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 532/1078] 10.222.0.79 () {60 vars in 1456 bytes} [Wed Jul 20 19:35:39 2022] DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments/d96d7c75-f9a3-4f0d-9491-ff81ad92fd00 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:35:40.109536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:40.110631 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.117327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.117870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.118959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.119544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.203989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2ac410ff-aa60-4403-8141-ec340c4df0ae tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/action" status: 202 len: 0 microversion: 2.20 time: 0.098510 Jul 20 19:35:40.204606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 547/1079] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 19:35:40 2022] POST /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:35:40.220857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.221436 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.229699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.230251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.231105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.231577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.381652 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.389962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.391846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:40.393357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4f8a81cc-af2e-406a-b0f9-084471570311 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1672 microversion: 2.20 time: 0.176860 Jul 20 19:35:40.393991 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 533/1080] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:40 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:41.024220 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.025277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.032386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.032845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.033658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.034097 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.065055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b8e11ac2-bc42-4403-8a0d-0263747b4b37 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044695 Jul 20 19:35:41.065530 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 548/1081] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:41.210385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.210880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.216998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.217455 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.218222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.218686 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.247830 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a47adec4-10f7-4f72-b6db-ea7cf06eac20 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1" status: 200 len: 194 microversion: 2.1 time: 0.041446 Jul 20 19:35:41.248500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 534/1082] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:41.258757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.259249 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.265451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.265901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.267355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.267785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.350960 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lazy-loading 'services' on Instance uuid 324db5cc-5507-42f6-8814-856da9645d90 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:41.411659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.412778 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.419732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.420327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.421193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.421691 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.436992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7075327c-db1a-403d-864a-e239eb86178c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1" status: 202 len: 0 microversion: 2.1 time: 0.181847 Jul 20 19:35:41.437603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 549/1083] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:35:41 2022] DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/cf685ff8-dcfe-4d9e-a379-8c736cc9f6a1 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:41.570996 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.579987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.581528 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:41.582952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cf16b50a-777e-4446-95d4-8dca68eb2bc4 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.175190 Jul 20 19:35:41.583517 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 535/1084] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:42.602693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:42.603384 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:42.609609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.610200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:42.610790 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:42.611224 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:42.780098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:42.790333 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:42.792417 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:42.794430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b41cfb66-98d3-4b66-ad9e-fd44dec746a8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.196393 Jul 20 19:35:42.795636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 550/1085] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:42 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:43.627446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:43.628078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:43.643797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.646847 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.648331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.649773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.660725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-263785620", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2006792000", "security_groups": [{"name": "tempest-secgroup-smoke-7941455"}], "block_device_mapping_v2": [{"uuid": "e09e66f7-b126-4bfb-b002-6d7baae03a2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b"}]}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:43.726998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e260d70b-e0c5-4717-a6ee-db8f2098cf5f tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/7afbcde1-fd7f-4794-9ad0-ee33ca529ec3" status: 200 len: 194 microversion: 2.1 time: 0.105503 Jul 20 19:35:43.736129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 536/1086] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 19:35:43 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/7afbcde1-fd7f-4794-9ad0-ee33ca529ec3 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:43.746166 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:43.748273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:43.761991 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.763780 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.765386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:43.767938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:43.856401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] validate_networks() for [('bfcdfdd1-0a96-4a12-ba67-6cce55dafa6b', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:35:43.887988 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lazy-loading 'services' on Instance uuid 324db5cc-5507-42f6-8814-856da9645d90 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:44.024240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6b107609-7819-4896-aed9-2802bca640a6 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/7afbcde1-fd7f-4794-9ad0-ee33ca529ec3" status: 202 len: 0 microversion: 2.1 time: 0.283998 Jul 20 19:35:44.025510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 537/1087] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:35:43 2022] DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments/7afbcde1-fd7f-4794-9ad0-ee33ca529ec3 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:44.040675 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:44.042184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:44.063491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.067418 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.068368 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.069974 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.352391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.362497 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.364037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:44.368408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3ad9f49a-3acb-4ccc-9b47-745a171ad67e tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.340851 Jul 20 19:35:44.369001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 538/1088] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:44 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:44.608479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:35:44.608978 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:35:44.610295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:35:44.610909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:35:44.611602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:35:44.632490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.634963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.636131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:44.641656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:44.691731 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:35:44.700499 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Getting quotas for user 493d126879f44b26951920235e7f7730 and project 3f1255754afb4cd384a11c87a9d717df. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:35:44.819722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:35:44.821827 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e09e66f7-b126-4bfb-b002-6d7baae03a2b',volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:35:45.025045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f3bec9c0-c8ad-4fe6-8d6b-7899235929a1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.367510 Jul 20 19:35:45.032375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 551/1089] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:35:43 2022] POST /compute/v2.1/servers => generated 403 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:35:45.038341 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aeca0c34-066e-4f08-81c2-1c6e7eac3185 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:45.040047 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-aeca0c34-066e-4f08-81c2-1c6e7eac3185 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:45.120334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aeca0c34-066e-4f08-81c2-1c6e7eac3185 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.131938 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aeca0c34-066e-4f08-81c2-1c6e7eac3185 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1094 microversion: 2.1 time: 0.097051 Jul 20 19:35:45.133364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 539/1090] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:45 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:45.387724 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:45.388596 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:45.400847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.401963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.403494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:45.411256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:45.708194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.716124 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.717661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:45.718808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ef61a2b9-1b53-417e-9a29-b7d5e3842195 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.335497 Jul 20 19:35:45.719969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 552/1091] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:45 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:46.150954 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:46.160511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:46.169445 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.170274 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.171293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.171803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.284817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.307942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fc925bd1-3752-4210-a0ca-4ea07d5d3b02 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.161053 Jul 20 19:35:46.308550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 540/1092] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:46 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:46.740751 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:46.741812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:46.750843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.751589 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.752547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:46.753611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:46.911269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.924544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.926278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:46.927958 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-897a3943-5660-4e4c-9312-e3505b9a0dc6 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.194106 Jul 20 19:35:46.939192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 553/1093] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:46 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:47.329817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.331226 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:47.340402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.340853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.341870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.342311 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.345441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:47.412582 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:47.420036 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-be35202e-d748-4f02-9e30-a839d80bb060 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.096574 Jul 20 19:35:47.420587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 541/1094] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:47.946902 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.947523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:47.954131 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.954525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:47.955303 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:47.955750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.088079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.096801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.098341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.099500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-38f52563-3c2f-48a8-9e34-c504f3dbfe7f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.156507 Jul 20 19:35:48.100065 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 554/1095] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:48.441053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:48.443729 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:48.458795 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:48.459629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.460633 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:48.461324 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:48.550977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:48.566122 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f5427e54-bf9b-4e12-9509-ed95a360a766 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.133588 Jul 20 19:35:48.567879 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 542/1096] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:48 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:49.118388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:49.118963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:49.126450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.127016 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.127725 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.128185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.272271 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.280436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.282032 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.283203 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c269d88b-3c1f-4856-81e6-4d7695cd0618 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.168894 Jul 20 19:35:49.283766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 555/1097] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:49 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:49.583832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:49.584447 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:49.591263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.591716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.592490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:49.592953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:49.658975 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:49.666740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f8e56bcb-baf7-4d62-9533-15a1aa3c21d2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.086791 Jul 20 19:35:49.667313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 543/1098] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:49 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:50.304170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:50.304824 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:50.311495 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.311945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.312854 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.313703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.464657 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.473656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.475185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.476356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-251e848f-3cd7-44d4-accc-6b86ba7e8a62 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.176157 Jul 20 19:35:50.476942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 556/1099] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:50 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:50.685159 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:50.687410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:50.705433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.706185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.707303 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:50.707942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:50.772950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:50.780340 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-33eb951d-8ea8-4c2b-937a-a80a9386d4a9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.099685 Jul 20 19:35:50.780983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 544/1100] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:50 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:51.494355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.494965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:51.502382 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.502830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.503801 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.504395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.662961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.671288 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.672810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.674023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-153792e8-432c-4c54-a196-ffc605a960df tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.183554 Jul 20 19:35:51.674573 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 557/1101] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:51.798475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.799119 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:51.805886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.806339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.807116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:51.807556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:51.878545 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:51.887149 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f05a4ee5-f47f-4c13-b13c-efb3912d795b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.092708 Jul 20 19:35:51.888043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 545/1102] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:52.697286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.707347 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:52.714120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.714585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.715371 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.715816 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.866160 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.875007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.877583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.878750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-168f85e3-35aa-4ad5-b2ec-23a2d4acc22f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.189734 Jul 20 19:35:52.885069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 558/1103] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:52.909454 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.910141 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:52.917524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.917524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.918619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:52.919030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:52.986690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:52.994269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4bb4efc0-0f7c-497e-94bf-65facd97471b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1144 microversion: 2.1 time: 0.088949 Jul 20 19:35:52.994836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 546/1104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:53.898119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:53.898665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:53.904591 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:53.905076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:53.905842 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:53.906315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.011819 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:54.012437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:54.019762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.020462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.021297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:54.021741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:54.040485 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:54.048762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:54.050306 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:54.051496 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e96fefaf-c21b-439e-bc68-8276712bdc34 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.157618 Jul 20 19:35:54.052068 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 559/1105] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:53 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:54.083707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:54.091074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-43a4b868-158c-4d50-8e75-5891e941ef7a tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1136 microversion: 2.1 time: 0.083285 Jul 20 19:35:54.091638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 547/1106] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:54 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:55.069681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:55.070836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:55.073326 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:55.073985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:55.079459 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.079918 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.080705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.081201 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.107483 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:55.108258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:55.114801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.115246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.116009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.116435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.132009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:55.198771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.207392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d7b610d5-a4ec-4ce7-9e09-ebc900948474 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1192 microversion: 2.1 time: 0.103668 Jul 20 19:35:55.207984 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 548/1107] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:55 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:35:55.236592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.248141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.249963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:55.251307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2253c7ba-291d-46ed-9b7e-d05a66e42aeb tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.185623 Jul 20 19:35:55.251861 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 560/1108] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:55 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:35:55.948904 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:55.949905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:55.956481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.956953 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.957723 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:55.958161 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:55.987344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-89a0248e-7a7a-468c-9137-86cd41862e3c tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042490 Jul 20 19:35:55.987922 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 549/1109] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:55 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:35:56.137488 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.139286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.146779 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.147490 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.148448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.149078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.170352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:56.180950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-782eddc7-f146-4021-903f-a2a167c08d11 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048001 Jul 20 19:35:56.181799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 561/1110] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:35:56.225135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.226246 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.233058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.233745 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.234749 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.235183 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.269411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.270025 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.281570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.282325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.283534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.290012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.319757 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.331537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2d89272e-759d-4cf9-a4fe-118db6b49b18 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1210 microversion: 2.1 time: 0.110275 Jul 20 19:35:56.332404 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 550/1111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:56.338207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.338936 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.345836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.346272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.347175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.347617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.388350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:35:56.502451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.511502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.519679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.521374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-85bd3a22-623d-4f52-8821-75ba83da350c tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.256285 Jul 20 19:35:56.522975 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 562/1112] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:56.541858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0ef55e92-4e4d-48ac-85c3-e6d595c5381b tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 204 len: 0 microversion: 2.1 time: 0.207262 Jul 20 19:35:56.542712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 551/1113] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:56 2022] DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:35:56.552270 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:56.553221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:56.560359 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.561180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.563239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:56.564225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:56.730794 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:56.739913 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4563139d-e251-4ee3-aa3a-af838d51cd49 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1671 microversion: 2.1 time: 0.192811 Jul 20 19:35:56.749955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 563/1114] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:56 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:57.351378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:57.352083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:57.358572 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.359026 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.360050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.360496 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.540602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:57.541244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:57.546759 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.549137 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.549595 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.550431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.550865 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.556293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-796bbe86-41da-4427-bb11-d8483c8b2ee9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1275 microversion: 2.1 time: 0.209359 Jul 20 19:35:57.557345 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 552/1115] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:57 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:57.723281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.731328 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.732847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.734374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e081302f-1f19-46f0-a098-a6ecd6959a3f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.198483 Jul 20 19:35:57.735487 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 564/1116] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:57 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:57.761205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:57.762739 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:57.773093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.773733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.774756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:57.775220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:57.969673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:57.977587 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ceacad71-c3ec-441c-8170-2d75c70bd48e tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1671 microversion: 2.1 time: 0.223176 Jul 20 19:35:57.978449 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 553/1117] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:57 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:58.027793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-3403b36f-aa93-484d-b3dd-1088317e13b3 req-1c157507-8dc8-4761-afa8-a138d90d723b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "name": "network-vif-plugged", "status": "completed", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:58.038669 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3403b36f-aa93-484d-b3dd-1088317e13b3 req-1c157507-8dc8-4761-afa8-a138d90d723b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.039413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-3403b36f-aa93-484d-b3dd-1088317e13b3 req-1c157507-8dc8-4761-afa8-a138d90d723b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.056942 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-3403b36f-aa93-484d-b3dd-1088317e13b3 req-1c157507-8dc8-4761-afa8-a138d90d723b service nova] Creating event network-vif-plugged:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:35:58.062267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-3403b36f-aa93-484d-b3dd-1088317e13b3 req-1c157507-8dc8-4761-afa8-a138d90d723b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038005 Jul 20 19:35:58.063603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 565/1118] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:58.576164 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:58.584380 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:58.592682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.593440 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.595136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.595747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.753944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:58.755259 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:58.774495 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.776086 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:58.777264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:58.778080 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.040036 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.050955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-9d72269e-b4d6-4344-bcae-e20e6104ab59 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.480695 Jul 20 19:35:59.052187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 554/1119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:58 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:59.064485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-4c48f246-8e3a-439e-8d73-45d65b6fc6cf req-8cfb7a5a-0f03-40f8-822c-c392b15154a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2dbe30-65a1-4318-8019-8e8b9cb724e8", "tag": "b629eaba-44a3-4a33-af05-3aa3cbd94f91"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:59.073422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-4c48f246-8e3a-439e-8d73-45d65b6fc6cf req-8cfb7a5a-0f03-40f8-822c-c392b15154a4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.074115 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-4c48f246-8e3a-439e-8d73-45d65b6fc6cf req-8cfb7a5a-0f03-40f8-822c-c392b15154a4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.091498 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-4c48f246-8e3a-439e-8d73-45d65b6fc6cf req-8cfb7a5a-0f03-40f8-822c-c392b15154a4 service nova] Creating event network-changed:b629eaba-44a3-4a33-af05-3aa3cbd94f91 for instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 on hv-cinder-85054 Jul 20 19:35:59.097893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-4c48f246-8e3a-439e-8d73-45d65b6fc6cf req-8cfb7a5a-0f03-40f8-822c-c392b15154a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043606 Jul 20 19:35:59.099050 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 555/1120] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:59.115681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:59.117043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:59.124934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.125414 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.126217 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:59.126659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:59.144189 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.158447 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.160321 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.161750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-617e09e0-b53a-46fd-9162-906ec0b252b0 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.412692 Jul 20 19:35:59.162818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 566/1121] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:35:58 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:35:59.672105 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:59.675799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:59.681199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cc82989f-b7d5-435e-b4f5-1cfe1565d735 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1671 microversion: 2.1 time: 0.580544 Jul 20 19:35:59.681958 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 556/1122] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:59 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1671 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:00.068101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:00.068832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:00.075148 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:00.077485 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.078822 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.079862 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.080410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.182139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:00.183425 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:00.195998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.196481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.197318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.197761 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.391260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.408502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f8f3eb1d-f67d-4834-a0bc-699068c72816 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.341284 Jul 20 19:36:00.413463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 567/1123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:00 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:00.418508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-4c1f9703-b0da-4e29-8e79-19007815d51f req-dddbe995-0598-4966-b48f-23ca81c86c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324db5cc-5507-42f6-8814-856da9645d90", "name": "network-vif-deleted", "tag": "e7b6841e-bfd1-409d-8c32-4732c85f1421"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:00.428634 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4c1f9703-b0da-4e29-8e79-19007815d51f req-dddbe995-0598-4966-b48f-23ca81c86c0b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.429421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4c1f9703-b0da-4e29-8e79-19007815d51f req-dddbe995-0598-4966-b48f-23ca81c86c0b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.433764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.441884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-4c1f9703-b0da-4e29-8e79-19007815d51f req-dddbe995-0598-4966-b48f-23ca81c86c0b service nova] Creating event network-vif-deleted:e7b6841e-bfd1-409d-8c32-4732c85f1421 for instance 324db5cc-5507-42f6-8814-856da9645d90 on hv-cinder-85054 Jul 20 19:36:00.443225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.444701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.446292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1710375e-ed84-434d-b02e-1583044584c3 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.269075 Jul 20 19:36:00.447444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 557/1124] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:00 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:36:00.452699 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-4c1f9703-b0da-4e29-8e79-19007815d51f req-dddbe995-0598-4966-b48f-23ca81c86c0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Jul 20 19:36:00.456864 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 568/1125] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:00.699409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:00.700039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:00.710876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.711379 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.712282 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:00.712725 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:00.790077 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7758d298f642138b71aa422d0344da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f994a0231b4176b8181d13d58ee9ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:00.799353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bf0e39ac-b456-4d5e-be31-2212718b3487 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 200 len: 1603 microversion: 2.1 time: 0.104695 Jul 20 19:36:00.801063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 558/1126] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:00 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 1603 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:01.430295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:01.431136 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:01.437451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.437909 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.438697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.439139 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.466197 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:01.467007 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:01.474114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.474568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.475337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.475772 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.733217 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:01.742107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-edc12bf3-de43-4e5d-a5e4-a4c74e7288ab tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.316450 Jul 20 19:36:01.743021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 569/1127] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:01 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:01.761856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:01.770965 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:01.773209 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:01.774643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2237ab0e-8bb0-408f-9d4b-663554608ce8 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1730 microversion: 2.20 time: 0.313523 Jul 20 19:36:01.775413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 559/1128] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:01 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1730 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:36:01.817818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:01.818439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:01.824752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.826401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.827199 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:01.828398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:01.855803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 HTTP/1.1 Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:01.858157 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:01.860503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '324db5cc-5507-42f6-8814-856da9645d90'} Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:01.861890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:01.863513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:01.865058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:01.865058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-09b10a3d-f89c-4109-892f-0e81514a55b3 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 404 len: 111 microversion: 2.1 time: 0.046677 Jul 20 19:36:01.865058 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 570/1129] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:01 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:01.870461 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-19c91e7b-4e91-49f6-9b15-3ec30eae9c1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '.version_select at 0x7f0e85ec44c0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:01.877826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:01.894927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-19c91e7b-4e91-49f6-9b15-3ec30eae9c1a tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343983805" status: 202 len: 0 microversion: 2.1 time: 0.028372 Jul 20 19:36:01.895562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 560/1130] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 19:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343983805 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:36:02.760373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:02.760933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:02.768427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.768905 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.769693 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.770150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.794098 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:02.794687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:02.800845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.801329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.802104 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:02.802539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:02.960295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:02.972231 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-958a3480-6080-4871-8090-56f7a0bfa33b tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.215637 Jul 20 19:36:02.972831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 571/1131] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:02 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:02.993598 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:03.002043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:03.003537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:03.004697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b3572749-b7c1-4299-90d1-d0736026d824 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1717 microversion: 2.20 time: 0.215112 Jul 20 19:36:03.005296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 561/1132] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:02 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1717 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:36:03.989261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:03.989882 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:03.996386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:03.996843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:03.997647 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:03.998090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:04.132450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:04.140241 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-eee201f1-d405-48bf-af2f-707aa550ba64 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.154908 Jul 20 19:36:04.141401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 572/1133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:03 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:05.158227 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:05.158845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:05.165835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:05.166292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:05.167053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:05.167490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:05.302214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:05.309680 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2a316f43-1d18-4e55-9c40-b5d9870a4cdb tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.155884 Jul 20 19:36:05.310244 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 562/1134] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:05 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:06.326932 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:06.327541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:06.334706 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.335158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.335916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.336346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.470424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:06.477840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1cdc5a40-c37a-485b-b745-8cb36f428879 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.154758 Jul 20 19:36:06.478395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 573/1135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:06 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:07.494593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:07.495462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:07.502836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:07.503312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:07.504101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:07.504533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:07.652748 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:07.660666 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4b72d545-9748-4cda-b641-55762db7082e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.170224 Jul 20 19:36:07.661264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 563/1136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:07 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:08.000965 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:08.001509 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:08.007901 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.008348 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.009138 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.009570 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.023216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 HTTP/1.1 Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:08.024723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.026346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '324db5cc-5507-42f6-8814-856da9645d90'} Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:08.027221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.028737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.030339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:08.030339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e1dc3550-d800-43d6-938f-e8a403ffdaa8 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 404 len: 111 microversion: 2.1 time: 0.029168 Jul 20 19:36:08.030339 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 574/1137] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:36:07 2022] DELETE /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:08.035280 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:08.035883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 324db5cc-5507-42f6-8814-856da9645d90] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:08.042066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.042508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.043263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.043692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.056807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 HTTP/1.1 Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:36:08.058519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.060091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '324db5cc-5507-42f6-8814-856da9645d90'} Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:08.061191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. Jul 20 19:36:08.063503 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:08.065116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 324db5cc-5507-42f6-8814-856da9645d90 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:08.065116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ba09bb82-3a05-486f-99e2-13b41e8386e0 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90" status: 404 len: 111 microversion: 2.1 time: 0.029231 Jul 20 19:36:08.065116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 564/1138] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:08 2022] GET /compute/v2.1/servers/324db5cc-5507-42f6-8814-856da9645d90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:08.678393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:08.679001 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:08.685007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.685456 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.686214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.686650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.821871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:08.829743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-76cf9aa2-8851-43e4-9689-99d8c33951d6 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.155167 Jul 20 19:36:08.830316 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 575/1139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:08 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:09.197809 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:09.198350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:09.205642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.206095 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.206855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.207292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.221530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 HTTP/1.1 Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:36:09.223056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.224646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '05854927-1ff5-4246-9509-c677fbb0a9f2'} Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:09.225507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.226918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.228460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:09.228460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5f97189f-aa3a-43b5-8a9b-5cabc66b3168 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jul 20 19:36:09.228460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 565/1140] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:36:09 2022] DELETE /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:09.237715 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:09.238660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] [instance: 05854927-1ff5-4246-9509-c677fbb0a9f2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:09.245258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.245781 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.246554 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.247365 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.260379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] HTTP exception thrown: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Request method failure captured: Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 HTTP/1.1 Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fc_bhMQMnlxmp71gatf6CVLio23HdoKYXRigQtBGyD2GLpIOgBVkGUmXftgIAVzE3cEUVWz9ucmEedM4iTj1R07-IdpOGaLUuhPrAJYatdXSNJJe7flVhv7maaw5S3fG3wVNUYjivkTqEcFUfFgbqqf6mYlby5Dvk08U47tWhS3V3g Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:09.261924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02f994a0231b4176b8181d13d58ee9ec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02f994a0231b4176b8181d13d58ee9ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 02f994a0231b4176b8181d13d58ee9ec Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1254497671 Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 3f7758d298f642138b71aa422d0344da Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeTestJSON-1254497671-project Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.263505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '05854927-1ff5-4246-9509-c677fbb0a9f2'} Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:09.264386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. Jul 20 19:36:09.266549 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:09.267831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] Returning 404 to user: Instance 05854927-1ff5-4246-9509-c677fbb0a9f2 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:09.267831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8a25c763-2ffc-4eab-805d-776eb745bd61 tempest-AttachVolumeTestJSON-1254497671 tempest-AttachVolumeTestJSON-1254497671-project] 10.222.0.79 "GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2" status: 404 len: 111 microversion: 2.1 time: 0.030815 Jul 20 19:36:09.267831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 576/1141] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:09 2022] GET /compute/v2.1/servers/05854927-1ff5-4246-9509-c677fbb0a9f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:09.853309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:09.853309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:09.853309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.853309 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.853800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.854240 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:10.088696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:10.097664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-bd9091f4-76fd-4eb3-90cb-c9911dcfdf2f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.255553 Jul 20 19:36:10.107549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 566/1142] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:09 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:11.115438 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:11.116836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:11.126107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:11.126992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:11.128207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:11.128821 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:11.668680 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:11.677488 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-19921235-c23e-45fc-a2bf-9ce949188750 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.565902 Jul 20 19:36:11.678248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 577/1143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:11 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:12.088262 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-92e9b6f4-0f18-4c9c-b83d-5e4bfcdb6d68 req-8cd91521-a13f-4f5d-b9c4-7f0c35612b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2dbe30-65a1-4318-8019-8e8b9cb724e8", "name": "network-vif-plugged", "status": "completed", "tag": "b629eaba-44a3-4a33-af05-3aa3cbd94f91"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:12.109146 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-92e9b6f4-0f18-4c9c-b83d-5e4bfcdb6d68 req-8cd91521-a13f-4f5d-b9c4-7f0c35612b65 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:12.109864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-92e9b6f4-0f18-4c9c-b83d-5e4bfcdb6d68 req-8cd91521-a13f-4f5d-b9c4-7f0c35612b65 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:12.121709 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-92e9b6f4-0f18-4c9c-b83d-5e4bfcdb6d68 req-8cd91521-a13f-4f5d-b9c4-7f0c35612b65 service nova] Creating event network-vif-plugged:b629eaba-44a3-4a33-af05-3aa3cbd94f91 for instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 on hv-cinder-85054 Jul 20 19:36:12.127805 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-92e9b6f4-0f18-4c9c-b83d-5e4bfcdb6d68 req-8cd91521-a13f-4f5d-b9c4-7f0c35612b65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043560 Jul 20 19:36:12.129042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 567/1144] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:12.695839 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:12.697100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:12.707345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:12.707808 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:12.708606 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:12.713670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:12.897060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:12.905263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-afa4d3b5-1932-4f85-86da-6b415aa611e2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1263 microversion: 2.1 time: 0.213276 Jul 20 19:36:12.906356 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 578/1145] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:12 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:13.924004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:13.924714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:13.931153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:13.931605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:13.932383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:13.933039 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:14.096792 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:14.110214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d542164e-e1f5-4bd3-8c39-2016e0c4e543 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1450 microversion: 2.1 time: 0.190771 Jul 20 19:36:14.111383 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 568/1146] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:13 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1450 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:14.127599 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:14.128807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:14.143258 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:14.143734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:14.144527 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:14.145015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:14.299398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:14.308125 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d5db55a8-eb59-48cf-9552-3373209643f1 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1450 microversion: 2.1 time: 0.184142 Jul 20 19:36:14.320428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 579/1147] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:14 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:17.514287 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-61f177f8-4e8a-4c66-8986-1cddfd35194f req-db7273ea-5f89-4464-ba39-5512331be506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2dbe30-65a1-4318-8019-8e8b9cb724e8", "tag": "b629eaba-44a3-4a33-af05-3aa3cbd94f91"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:17.541185 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-61f177f8-4e8a-4c66-8986-1cddfd35194f req-db7273ea-5f89-4464-ba39-5512331be506 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:17.541948 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-61f177f8-4e8a-4c66-8986-1cddfd35194f req-db7273ea-5f89-4464-ba39-5512331be506 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:17.578100 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-61f177f8-4e8a-4c66-8986-1cddfd35194f req-db7273ea-5f89-4464-ba39-5512331be506 service nova] Creating event network-changed:b629eaba-44a3-4a33-af05-3aa3cbd94f91 for instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 on hv-cinder-85054 Jul 20 19:36:17.586589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-61f177f8-4e8a-4c66-8986-1cddfd35194f req-db7273ea-5f89-4464-ba39-5512331be506 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076651 Jul 20 19:36:17.591294 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 569/1148] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:21.002685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-25ca27df-7903-4c9e-b256-9a2f113c2427 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: .version_select at 0x7f0e85955430>, body: {"keypair": {"name": "tempest-keypair-1198947595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLXyqil6h16tKluq+d2X+a0tr9pLI36dStWY4APB2V7m+MY4isq3+CBkAYke4vqA4n0mTgltTtfef8Ia0y3pBrz/84RhNQTwaLPWrXQ2V+mc51WCzO8x4/qFbGxYHRbiw=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:21.019756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-25ca27df-7903-4c9e-b256-9a2f113c2427 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:36:21.024664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-25ca27df-7903-4c9e-b256-9a2f113c2427 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:36:21.051866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-25ca27df-7903-4c9e-b256-9a2f113c2427 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234058 Jul 20 19:36:21.052479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 580/1149] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:22.621067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-24428408", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4806620-4962-4134-99b4-81d4c833434f"}], "security_groups": [{"name": "tempest-securitygroup--1392550580"}], "key_name": "tempest-keypair-1198947595", "user_data": "}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:22.755218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] validate_networks() for [('f4806620-4962-4134-99b4-81d4c833434f', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:36:23.500930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:36:23.501785 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:36:23.502494 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:36:23.502994 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:36:23.503524 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:36:23.513962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:23.514653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:23.515581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:23.516114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:23.543641 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:36:23.549038 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:36:23.563664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:36:23.566415 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:36:23.630422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4db54207-1d2b-4169-9423-ef328b1cf88a tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.012692 Jul 20 19:36:23.631508 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 570/1150] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:36:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:36:23.645337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7a154ef6-d932-4ca8-bf03-1f67956696ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:23.648540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7a154ef6-d932-4ca8-bf03-1f67956696ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:23.747907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-7a154ef6-d932-4ca8-bf03-1f67956696ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:23.756292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7a154ef6-d932-4ca8-bf03-1f67956696ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1240 microversion: 2.1 time: 0.117806 Jul 20 19:36:23.757602 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 581/1151] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:23 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:24.774870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:24.776187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:24.801058 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:24.801573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:24.802288 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:24.802721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:24.896378 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:24.905116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a2b3eae1-604a-495e-9db9-d68db79e1074 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1292 microversion: 2.1 time: 0.134760 Jul 20 19:36:24.906220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 571/1152] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:24 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1292 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:25.924235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:25.926218 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:25.929368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=92 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:25.940414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:25.940916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:25.942111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:25.942917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:26.032289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:26.054458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-47a0fe5e-a886-486e-8c88-681b55b9edb6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1298 microversion: 2.1 time: 0.134223 Jul 20 19:36:26.056927 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 582/1153] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:25 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:27.083009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:27.084273 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:27.091331 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:27.092054 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:27.093281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:27.094207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:27.330643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:27.338752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5416b003-b5ab-473c-a233-1f44b5a5c3ce tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.259536 Jul 20 19:36:27.339615 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 572/1154] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:27 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:27.380702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-b97211d5-c3c0-4d44-b04f-efce28f6df68 req-4a5c260a-4f4d-4cbc-b226-74d970ded0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c936cd-d435-4fb2-b37c-413b8e71ffab", "tag": "4a0cbc8c-9546-4996-abd6-a592176c93a7"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:27.390522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-b97211d5-c3c0-4d44-b04f-efce28f6df68 req-4a5c260a-4f4d-4cbc-b226-74d970ded0e1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:27.390900 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-b97211d5-c3c0-4d44-b04f-efce28f6df68 req-4a5c260a-4f4d-4cbc-b226-74d970ded0e1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:27.406075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-b97211d5-c3c0-4d44-b04f-efce28f6df68 req-4a5c260a-4f4d-4cbc-b226-74d970ded0e1 service nova] Creating event network-changed:4a0cbc8c-9546-4996-abd6-a592176c93a7 for instance 03c936cd-d435-4fb2-b37c-413b8e71ffab on hv-cinder-85054 Jul 20 19:36:27.411088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-b97211d5-c3c0-4d44-b04f-efce28f6df68 req-4a5c260a-4f4d-4cbc-b226-74d970ded0e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035001 Jul 20 19:36:27.411697 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 583/1155] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:28.355818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:28.356423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:28.363937 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:28.364389 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:28.365199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:28.365643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:28.500367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:28.507697 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e4af9ce9-8304-4dcf-838a-e6421a7eca25 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.155733 Jul 20 19:36:28.508495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 573/1156] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:28 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:29.527628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:29.528394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:29.536452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:29.536928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:29.537986 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:29.538427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:29.672017 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:29.679548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ac2ea566-cda7-4f09-ac0a-796e0a6c7404 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.156961 Jul 20 19:36:29.680116 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 584/1157] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:29 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:30.697405 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:30.698222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:30.705872 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:30.706323 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:30.707096 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:30.707532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:30.711926 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=78 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:30.846726 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:30.854206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-02c0228f-b0ab-48f9-9861-b0e295605ec9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.161400 Jul 20 19:36:30.854762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 574/1158] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:30 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:36:31.871949 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:31.872514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:31.875076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:31.881437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:31.881888 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:31.882661 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:31.883107 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:32.022184 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:32.030536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4d566702-b895-4789-8316-6fbd3b0d9e8e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.162390 Jul 20 19:36:32.032785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 585/1159] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:31 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:32.113900 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-61fcc18b-3735-4827-9a3c-273ff57026c6 req-f3c5b461-7317-4735-960e-df13463acc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c936cd-d435-4fb2-b37c-413b8e71ffab", "name": "network-vif-plugged", "status": "completed", "tag": "4a0cbc8c-9546-4996-abd6-a592176c93a7"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:32.117863 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:32.123518 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-61fcc18b-3735-4827-9a3c-273ff57026c6 req-f3c5b461-7317-4735-960e-df13463acc7e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:32.123924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-61fcc18b-3735-4827-9a3c-273ff57026c6 req-f3c5b461-7317-4735-960e-df13463acc7e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:32.136230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-61fcc18b-3735-4827-9a3c-273ff57026c6 req-f3c5b461-7317-4735-960e-df13463acc7e service nova] Creating event network-vif-plugged:4a0cbc8c-9546-4996-abd6-a592176c93a7 for instance 03c936cd-d435-4fb2-b37c-413b8e71ffab on hv-cinder-85054 Jul 20 19:36:32.141754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-61fcc18b-3735-4827-9a3c-273ff57026c6 req-f3c5b461-7317-4735-960e-df13463acc7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Jul 20 19:36:32.142365 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 575/1160] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:33.049890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:33.050507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:33.057379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:33.057870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:33.058681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:33.059222 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:33.202692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:33.211398 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c7b90871-4532-4cde-8845-bef90e6c5a08 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1366 microversion: 2.1 time: 0.166118 Jul 20 19:36:33.211898 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 586/1161] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:33 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:34.226851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.227651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.232560 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:34.233053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:34.240601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.241688 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:34.242485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.242929 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:34.378443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:34.386207 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-dd1f2db7-a783-45a7-95ae-45160f64104f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1555 microversion: 2.1 time: 0.160883 Jul 20 19:36:34.386713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 576/1162] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:34 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:34.403324 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:34.403844 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:34.405871 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.411818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.412269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:34.413330 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:34.413768 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:34.494449 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-40c78c6d-6c5b-4f67-85c3-baccf6a86782 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094905 Jul 20 19:36:34.495095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 587/1163] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:36:34 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:35.464018 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-d769c21b-0be0-43bc-8408-b238f700dddc req-081f66e7-90dc-4740-b521-cfd7fdb52079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c936cd-d435-4fb2-b37c-413b8e71ffab", "tag": "4a0cbc8c-9546-4996-abd6-a592176c93a7"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:35.472608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d769c21b-0be0-43bc-8408-b238f700dddc req-081f66e7-90dc-4740-b521-cfd7fdb52079 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:35.473085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d769c21b-0be0-43bc-8408-b238f700dddc req-081f66e7-90dc-4740-b521-cfd7fdb52079 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:35.485009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-d769c21b-0be0-43bc-8408-b238f700dddc req-081f66e7-90dc-4740-b521-cfd7fdb52079 service nova] Creating event network-changed:4a0cbc8c-9546-4996-abd6-a592176c93a7 for instance 03c936cd-d435-4fb2-b37c-413b8e71ffab on hv-cinder-85054 Jul 20 19:36:35.489998 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-d769c21b-0be0-43bc-8408-b238f700dddc req-081f66e7-90dc-4740-b521-cfd7fdb52079 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029625 Jul 20 19:36:35.490669 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 577/1164] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:36.787142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:36.788327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:36.794428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.794884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.795656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.797132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.827921 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d20e4b15-1647-41fc-8c96-565b906e6135 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044958 Jul 20 19:36:36.828436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 588/1165] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 19:36:36 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:36.888457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:36.889074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:36.896079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.896552 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.897471 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:36.897976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:36.925386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:36:37.003293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-55f1b24f-fcc7-408c-919b-87d4c492f83f tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 204 len: 0 microversion: 2.20 time: 0.119384 Jul 20 19:36:37.003845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 578/1166] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 19:36:36 2022] DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:36:37.012322 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:37.012959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:37.019765 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:37.020218 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:37.021022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:37.021463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:37.417267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:37.425256 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:37.426776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:37.427939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c9c3f412-2f31-49a1-a56d-0e585e44a3fe tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.419611 Jul 20 19:36:37.428503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 589/1167] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:37 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:36:38.447594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:38.448292 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:38.455000 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.455444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.456193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:38.456622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:38.586893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:38.594910 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:38.596412 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:38.597606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-80608d10-64f1-4f55-9d81-e992ae145368 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1723 microversion: 2.20 time: 0.154500 Jul 20 19:36:38.598172 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 579/1168] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:38 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:36:39.615881 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:39.616507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:39.623098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.623550 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.624327 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.624770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.713806 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:39.721850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:39.723371 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18c8d4034ce40dba9f9f48e96a19814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9f11498f9d4245910281ac3bd55470', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:39.724527 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ed23f5ed-a232-45d8-bc40-0a25510e1771 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 200 len: 1656 microversion: 2.20 time: 0.112615 Jul 20 19:36:39.725783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 590/1169] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:39 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 1656 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:36:39.790649 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-a098046d-3e1d-45ce-bfad-2f2fbc8abcb3 req-fef9b368-e071-409e-bcf5-478da12dee5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c72290e-2e8d-4d75-bc12-044982fde7e4", "name": "network-vif-deleted", "tag": "07d49545-8328-41a0-82f6-5d7bda469348"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:39.804703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-a098046d-3e1d-45ce-bfad-2f2fbc8abcb3 req-fef9b368-e071-409e-bcf5-478da12dee5e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:39.805519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-a098046d-3e1d-45ce-bfad-2f2fbc8abcb3 req-fef9b368-e071-409e-bcf5-478da12dee5e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:39.823890 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-a098046d-3e1d-45ce-bfad-2f2fbc8abcb3 req-fef9b368-e071-409e-bcf5-478da12dee5e service nova] Creating event network-vif-deleted:07d49545-8328-41a0-82f6-5d7bda469348 for instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 on hv-cinder-85054 Jul 20 19:36:39.829520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-a098046d-3e1d-45ce-bfad-2f2fbc8abcb3 req-fef9b368-e071-409e-bcf5-478da12dee5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044386 Jul 20 19:36:39.830533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 580/1170] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:40.743691 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:40.744492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:40.751664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.752118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.752931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:40.753429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:40.769346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 HTTP/1.1 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:40.771010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:40.772764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '0c72290e-2e8d-4d75-bc12-044982fde7e4'} Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:40.773649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:40.775195 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:40.776718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:40.776718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-16a61dc4-f5ba-46a3-be99-5ca00cde78a2 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 404 len: 111 microversion: 2.20 time: 0.032818 Jul 20 19:36:40.776718 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 591/1171] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:40 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:36:40.783080 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6ee65434-2268-48e3-8d2e-17eeec5b6d27 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '.version_select at 0x7f0e85cfbb80>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:40.801060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6ee65434-2268-48e3-8d2e-17eeec5b6d27 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925748532" status: 204 len: 0 microversion: 2.20 time: 0.023069 Jul 20 19:36:40.801952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 581/1172] 10.222.0.79 () {60 vars in 1258 bytes} [Wed Jul 20 19:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925748532 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:36:42.580701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:42.581238 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:42.587716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.588166 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.588955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.589392 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.603626 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 HTTP/1.1 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:42.605280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.607047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '0c72290e-2e8d-4d75-bc12-044982fde7e4'} Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:42.607849 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.610587 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.612052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:42.612052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-29bec819-7ae2-4dc0-91eb-1ffb14870d17 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 404 len: 111 microversion: 2.20 time: 0.029916 Jul 20 19:36:42.612052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 592/1173] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 19:36:42 2022] DELETE /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:36:42.616558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:42.617459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 0c72290e-2e8d-4d75-bc12-044982fde7e4] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:42.624204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.624647 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.625851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:42.626308 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:42.639469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 HTTP/1.1 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:36:42.641399 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.643074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '0c72290e-2e8d-4d75-bc12-044982fde7e4'} Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:42.643983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. Jul 20 19:36:42.645479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:42.646810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 0c72290e-2e8d-4d75-bc12-044982fde7e4 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:42.646810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-25bfc3b8-342e-4626-8e1c-c161c09e2164 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4" status: 404 len: 111 microversion: 2.20 time: 0.031025 Jul 20 19:36:42.646810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 582/1174] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:42 2022] GET /compute/v2.1/servers/0c72290e-2e8d-4d75-bc12-044982fde7e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:36:43.784457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:43.784985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:43.791831 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.792291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.793109 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.793553 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.809033 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb HTTP/1.1 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:36:43.810609 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.813141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '27cf917f-83ab-47d0-82d4-8d8dc896aacb'} Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:43.814551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.817800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.819345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:43.819345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9a352ecc-5718-4020-b982-1c8c351964dd tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 404 len: 111 microversion: 2.20 time: 0.031850 Jul 20 19:36:43.819345 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 593/1175] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 19:36:43 2022] DELETE /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:36:43.823448 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:43.824061 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] [instance: 27cf917f-83ab-47d0-82d4-8d8dc896aacb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:43.830594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.831040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.831797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:43.832230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:43.845420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] HTTP exception thrown: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Request method failure captured: Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb HTTP/1.1 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdB5YRbAYlkxfecXhop0llb63I-QOb3gH9xnxedKViNf36UN9hokyjpCxkhHzkB9nXnJ8LItDnQ53Jdlx_DQF6H012t34-wWWuMFrdv_ysyDLKgQYXM6Vt2zozSL5-W-FS0Amw8njGhU421M4fQXAce-p6ADwRD3wszymCfCM7HVE8 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:36:43.846916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca9f11498f9d4245910281ac3bd55470", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca9f11498f9d4245910281ac3bd55470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: ca9f11498f9d4245910281ac3bd55470 Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1236858908 Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: c18c8d4034ce40dba9f9f48e96a19814 Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1236858908-project Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.848762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '27cf917f-83ab-47d0-82d4-8d8dc896aacb'} Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:43.849584 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. Jul 20 19:36:43.850835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:36:43.851944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] Returning 404 to user: Instance 27cf917f-83ab-47d0-82d4-8d8dc896aacb could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:43.851944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b53be98d-88b2-4876-8301-9b1c16eda5e7 tempest-AttachVolumeShelveTestJSON-1236858908 tempest-AttachVolumeShelveTestJSON-1236858908-project] 10.222.0.79 "GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb" status: 404 len: 111 microversion: 2.20 time: 0.029297 Jul 20 19:36:43.851944 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 583/1176] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 19:36:43 2022] GET /compute/v2.1/servers/27cf917f-83ab-47d0-82d4-8d8dc896aacb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 19:37:19.149679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:19.150275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:19.152386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=17 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:19.153113 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=54 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:19.159273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.160409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.161253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:19.161694 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:19.186424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-887761a2-ebe6-44bf-8617-c9205a530450 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/ips" status: 200 len: 148 microversion: 2.1 time: 0.040626 Jul 20 19:37:19.187075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 594/1177] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:37:19 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:20.548238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ed7300f-cb38-4e1c-b2d5-1198c796c897"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:20.549703 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:20.552093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:20.552756 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:20.559822 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.560558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.561606 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:20.562224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:20.889675 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-03eac268-8305-4900-939f-af691c5273ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345149 Jul 20 19:37:20.890656 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 584/1178] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:37:20 2022] POST /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:28.406273 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-be633697-0e88-46a8-8a8f-6fad07deeeb0 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: .version_select at 0x7f0e85f08af0>, body: {"keypair": {"name": "tempest-keypair-1855316652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCfRw685RoXpjvQo2gnujnGXox1VU6j0XYJBspdYrc796w8KLLPYajZ8E53ky32HQ5qXiVsRIF2JIATXBKJRCxDLX7kVsEtBUFqokYCbASt2kZMbuDzDL8++Kr3Qb7aew=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:28.421343 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-be633697-0e88-46a8-8a8f-6fad07deeeb0 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:37:28.425427 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-be633697-0e88-46a8-8a8f-6fad07deeeb0 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:37:28.447759 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-be633697-0e88-46a8-8a8f-6fad07deeeb0 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045398 Jul 20 19:37:28.448351 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 595/1179] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:37:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:30.067302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-453309045", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4806620-4962-4134-99b4-81d4c833434f"}], "security_groups": [{"name": "tempest-securitygroup--2116149979"}], "key_name": "tempest-keypair-1855316652", "user_data": "}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:30.175211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] validate_networks() for [('f4806620-4962-4134-99b4-81d4c833434f', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:37:30.568296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:37:30.568857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:37:30.569967 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:37:30.571589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:37:30.572266 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:37:30.584856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.585639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.587009 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:30.587750 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:30.614131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:37:30.621594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:37:30.638263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:37:30.642635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:37:30.700463 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3c11fdbe-a385-41eb-86cc-1fb2db16c36f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.639200 Jul 20 19:37:30.701516 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 585/1180] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:37:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:37:30.711646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9e0910fb-f891-4de4-a97b-7bb3dbbe2204 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:30.712584 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9e0910fb-f891-4de4-a97b-7bb3dbbe2204 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:30.714880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=4 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:30.797595 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9e0910fb-f891-4de4-a97b-7bb3dbbe2204 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:30.806436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9e0910fb-f891-4de4-a97b-7bb3dbbe2204 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1241 microversion: 2.1 time: 0.099012 Jul 20 19:37:30.807012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 596/1181] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:30 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:31.829084 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:31.830800 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:31.839385 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.840220 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.845514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:31.846205 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:31.928392 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:31.938629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5e391dd0-203b-4347-ae7a-f7aa1810d979 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1311 microversion: 2.1 time: 0.118613 Jul 20 19:37:31.939908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 586/1182] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:31 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:32.957815 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:32.959155 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:32.966523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.967227 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:32.968186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:32.969615 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.210795 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:33.219670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-92aa6c3d-5e50-4b75-bf94-a1ec09894f3b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.266966 Jul 20 19:37:33.220264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 597/1183] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:32 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:33.550313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-b7f26e5c-1388-4c8b-abe1-424914410790 req-fcc47981-f735-4e48-be81-f1555a1aab08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ff6a43-e269-4575-925c-2b6e4e93dabb", "tag": "8a1ad294-9718-423e-a03a-bdffabd23eb9"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:33.566636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b7f26e5c-1388-4c8b-abe1-424914410790 req-fcc47981-f735-4e48-be81-f1555a1aab08 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:33.567278 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-b7f26e5c-1388-4c8b-abe1-424914410790 req-fcc47981-f735-4e48-be81-f1555a1aab08 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:33.581057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-b7f26e5c-1388-4c8b-abe1-424914410790 req-fcc47981-f735-4e48-be81-f1555a1aab08 service nova] Creating event network-changed:8a1ad294-9718-423e-a03a-bdffabd23eb9 for instance e3ff6a43-e269-4575-925c-2b6e4e93dabb on hv-cinder-85054 Jul 20 19:37:33.588608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-b7f26e5c-1388-4c8b-abe1-424914410790 req-fcc47981-f735-4e48-be81-f1555a1aab08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042484 Jul 20 19:37:33.589548 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 587/1184] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:37:34.235908 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:34.236612 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:34.243346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.243807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.244585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:34.245056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:34.397364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:34.410799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ec9940e1-5923-47cc-8caf-ba5bb6ccc70f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.173537 Jul 20 19:37:34.410799 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 598/1185] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:34 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:35.424310 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:35.425140 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:35.432917 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:35.433467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:35.434266 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:35.434827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:35.598797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:35.606635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4d3c4041-698d-4387-82d7-332c36348b36 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.186683 Jul 20 19:37:35.607201 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 588/1186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:35 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:36.622675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:36.623284 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:36.630088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:36.630536 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:36.631304 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:36.631735 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:36.765748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:36.773289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b1893706-7edc-4eb0-b278-71cac6000aa1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.154528 Jul 20 19:37:36.773866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 599/1187] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:36 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:37.790260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:37.790960 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:37.797608 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.798265 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.799601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:37.800033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:37.935364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:37.943418 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-183abefa-012c-4947-b4df-646bc75bea0c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.157357 Jul 20 19:37:37.944092 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 589/1188] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:37 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:38.503948 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-8e7374e8-c60a-4cd7-b230-b70de27c55d0 req-8621f7c3-e787-4901-b20a-0d60bcee6170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ff6a43-e269-4575-925c-2b6e4e93dabb", "name": "network-vif-plugged", "status": "completed", "tag": "8a1ad294-9718-423e-a03a-bdffabd23eb9"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:38.513007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-8e7374e8-c60a-4cd7-b230-b70de27c55d0 req-8621f7c3-e787-4901-b20a-0d60bcee6170 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.513418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-8e7374e8-c60a-4cd7-b230-b70de27c55d0 req-8621f7c3-e787-4901-b20a-0d60bcee6170 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.529738 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-8e7374e8-c60a-4cd7-b230-b70de27c55d0 req-8621f7c3-e787-4901-b20a-0d60bcee6170 service nova] Creating event network-vif-plugged:8a1ad294-9718-423e-a03a-bdffabd23eb9 for instance e3ff6a43-e269-4575-925c-2b6e4e93dabb on hv-cinder-85054 Jul 20 19:37:38.536756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-8e7374e8-c60a-4cd7-b230-b70de27c55d0 req-8621f7c3-e787-4901-b20a-0d60bcee6170 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035683 Jul 20 19:37:38.537547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 600/1189] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:38.961279 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:38.962017 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:38.968981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.969435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:38.970277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:38.970712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:39.112962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:39.127542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-46eaf754-8fce-4719-9572-221916d6fd67 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1367 microversion: 2.1 time: 0.169796 Jul 20 19:37:39.128594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 590/1190] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:38 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:40.147181 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:40.148530 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:40.157127 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.159442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.160448 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.160917 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.320315 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:40.330660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-68f5e3e7-75a0-4184-ab73-e1bfa352c02f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1557 microversion: 2.1 time: 0.188811 Jul 20 19:37:40.331354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 601/1191] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:40 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:40.349237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:40.349983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:40.357892 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.358665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.359723 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:40.360417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:40.453072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-720ce7fb-9349-49bb-abec-a0f82862fa01 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108636 Jul 20 19:37:40.453964 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 591/1192] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:37:40 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:41.597962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-17d404c2-9fb9-474d-9e00-91b406f88433 req-9a584adf-e79c-4936-a3bd-cae5e997f7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ff6a43-e269-4575-925c-2b6e4e93dabb", "tag": "8a1ad294-9718-423e-a03a-bdffabd23eb9"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:41.601641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:41.610663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-17d404c2-9fb9-474d-9e00-91b406f88433 req-9a584adf-e79c-4936-a3bd-cae5e997f7bc service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:41.611858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-17d404c2-9fb9-474d-9e00-91b406f88433 req-9a584adf-e79c-4936-a3bd-cae5e997f7bc service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:41.629212 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-17d404c2-9fb9-474d-9e00-91b406f88433 req-9a584adf-e79c-4936-a3bd-cae5e997f7bc service nova] Creating event network-changed:8a1ad294-9718-423e-a03a-bdffabd23eb9 for instance e3ff6a43-e269-4575-925c-2b6e4e93dabb on hv-cinder-85054 Jul 20 19:37:41.639818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-17d404c2-9fb9-474d-9e00-91b406f88433 req-9a584adf-e79c-4936-a3bd-cae5e997f7bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046571 Jul 20 19:37:41.641048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 602/1193] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:37:49.365773 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:49.366732 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:49.565562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f9ae9491-3466-419b-b24c-fac2168b8fcf tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Action: 'create', calling method: .version_select at 0x7f0e85e97b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-428519053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRFpvxxNbMMRrmdNKng/eVgswh6e3ETNrxhbRlQq5VSE/AuvF2t+cufxu5sWSX3snIvw4g/fYYf4FAEpuzjH1cMdCPmderpHCEGCPOBQnG3zxBxIcsCtGX//+CGFss2dw=="}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:49.579338 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-f9ae9491-3466-419b-b24c-fac2168b8fcf tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Getting quotas for project f3f0c2dd35fa4890a64fcc7dcaddc633. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:37:49.583955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-f9ae9491-3466-419b-b24c-fac2168b8fcf tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Getting quotas for user fc7827c5d9294b8c90f26deff983b8e3 and project f3f0c2dd35fa4890a64fcc7dcaddc633. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:37:49.606839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f9ae9491-3466-419b-b24c-fac2168b8fcf tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.241838 Jul 20 19:37:49.612839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 592/1194] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:37:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:37:55.848635 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.852079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.852944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=28 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.860027 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-19a49a82-7eb8-4d8c-8053-636a841c0f7a req-29d50147-64b6-4071-bba4-671f1cf302e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2dbe30-65a1-4318-8019-8e8b9cb724e8", "tag": "b629eaba-44a3-4a33-af05-3aa3cbd94f91"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:55.860367 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:55.861764 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:55.865068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.869380 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.869830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.871239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.871684 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.874472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-19a49a82-7eb8-4d8c-8053-636a841c0f7a req-29d50147-64b6-4071-bba4-671f1cf302e4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.874962 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-19a49a82-7eb8-4d8c-8053-636a841c0f7a req-29d50147-64b6-4071-bba4-671f1cf302e4 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.890618 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-19a49a82-7eb8-4d8c-8053-636a841c0f7a req-29d50147-64b6-4071-bba4-671f1cf302e4 service nova] Creating event network-changed:b629eaba-44a3-4a33-af05-3aa3cbd94f91 for instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 on hv-cinder-85054 Jul 20 19:37:55.896664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-19a49a82-7eb8-4d8c-8053-636a841c0f7a req-29d50147-64b6-4071-bba4-671f1cf302e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049121 Jul 20 19:37:55.897617 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 593/1195] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:55.902286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:37:55.996513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-27927260-479a-4839-b664-a6a1a1098147 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 204 len: 0 microversion: 2.1 time: 0.151038 Jul 20 19:37:55.998329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 603/1196] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:37:55 2022] DELETE /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:37:56.007320 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:56.008033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:56.020602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.023386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.024214 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.024604 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.319823 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:56.327856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1dcab198-349c-4905-b9bf-8321697e091e tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1575 microversion: 2.1 time: 0.324846 Jul 20 19:37:56.328446 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 594/1197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:56 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1575 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:57.346625 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:57.347414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:57.354719 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.355168 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.355969 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.356401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.549578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:57.557319 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6e68bbf1-33ae-4051-8ef1-ebe3fe5518e4 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1575 microversion: 2.1 time: 0.214921 Jul 20 19:37:57.557905 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 604/1198] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:57 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:58.575580 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:58.576895 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:58.583880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.584328 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.585138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.585575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.818811 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:58.831362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-47699571-a2dd-4e3f-bc58-f420fca638ff tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1456 microversion: 2.1 time: 0.260156 Jul 20 19:37:58.832206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 595/1199] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:58 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1456 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:59.049291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-9286ae42-807f-4401-a810-fdf30d0f56a2 req-3ce0fcc3-9848-4463-97a0-75d3e9878f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2dbe30-65a1-4318-8019-8e8b9cb724e8", "name": "network-vif-deleted", "tag": "b629eaba-44a3-4a33-af05-3aa3cbd94f91"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:59.059089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9286ae42-807f-4401-a810-fdf30d0f56a2 req-3ce0fcc3-9848-4463-97a0-75d3e9878f28 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.059563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-9286ae42-807f-4401-a810-fdf30d0f56a2 req-3ce0fcc3-9848-4463-97a0-75d3e9878f28 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.072223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-9286ae42-807f-4401-a810-fdf30d0f56a2 req-3ce0fcc3-9848-4463-97a0-75d3e9878f28 service nova] Creating event network-vif-deleted:b629eaba-44a3-4a33-af05-3aa3cbd94f91 for instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 on hv-cinder-85054 Jul 20 19:37:59.077703 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-9286ae42-807f-4401-a810-fdf30d0f56a2 req-3ce0fcc3-9848-4463-97a0-75d3e9878f28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Jul 20 19:37:59.078667 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 605/1200] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:59.848054 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:59.849040 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:59.851527 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=4 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:59.857546 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.857989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.858768 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.860630 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.891079 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.891520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.891959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lazy-loading 'fault' on Instance uuid 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:37:59.941435 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:59.949963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d3e0f500-684a-4619-9166-8fdcc0ef8d84 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 200 len: 1230 microversion: 2.1 time: 0.106209 Jul 20 19:37:59.953167 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 596/1201] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:59 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:00.971859 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:00.972520 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 6b2dbe30-65a1-4318-8019-8e8b9cb724e8] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:00.979078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.979533 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.980512 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.981007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.995603 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] HTTP exception thrown: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Request method failure captured: Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 HTTP/1.1 Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdxUlITYk0N5dpa5vFa4rfWNNWdm8rfhfsVPa-0fwdJMsmOuhAEMKiPsteV6183Wqa0P8CCO89JTSlE0gU-N4Z3ooCbz1itIsl0dp_twtambAQSERPaJvpbreRQ3z_CGshPyMf4_Jn2BAHsta2cJHyHrj7J5kpM3zvbT3mz2App72Y Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:38:00.997323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3f1255754afb4cd384a11c87a9d717df", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 493d126879f44b26951920235e7f7730 Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. Jul 20 19:38:00.999045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '6b2dbe30-65a1-4318-8019-8e8b9cb724e8'} Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:01.000010 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. Jul 20 19:38:01.001419 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:01.002945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Returning 404 to user: Instance 6b2dbe30-65a1-4318-8019-8e8b9cb724e8 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:01.002945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-37d415c9-5901-41f2-bc7f-07d693465ac3 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8" status: 404 len: 111 microversion: 2.1 time: 0.031647 Jul 20 19:38:01.002945 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 606/1202] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:00 2022] GET /compute/v2.1/servers/6b2dbe30-65a1-4318-8019-8e8b9cb724e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:04.117008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:04.117549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:04.119548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-4b2f0923-1403-4652-b76e-de41713ffd6a req-6313fe45-ad11-4a96-aa7c-305f282bd697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a7d635-c0fb-46d2-b8be-44ee48e97672", "tag": "adb97b7c-ab6c-4cac-8466-afb36a56cddd"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:04.125019 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.125701 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.126662 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.127101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.129069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4b2f0923-1403-4652-b76e-de41713ffd6a req-6313fe45-ad11-4a96-aa7c-305f282bd697 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.129613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-4b2f0923-1403-4652-b76e-de41713ffd6a req-6313fe45-ad11-4a96-aa7c-305f282bd697 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.144692 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-4b2f0923-1403-4652-b76e-de41713ffd6a req-6313fe45-ad11-4a96-aa7c-305f282bd697 service nova] Creating event network-changed:adb97b7c-ab6c-4cac-8466-afb36a56cddd for instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 on hv-cinder-85054 Jul 20 19:38:04.150654 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-4b2f0923-1403-4652-b76e-de41713ffd6a req-6313fe45-ad11-4a96-aa7c-305f282bd697 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034770 Jul 20 19:38:04.151660 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 607/1203] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:04.154507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:38:04.252582 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ebf5f799-f910-45d1-8edf-92be24e6fd5f tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 204 len: 0 microversion: 2.1 time: 0.140343 Jul 20 19:38:04.253495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 597/1204] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:38:04 2022] DELETE /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:38:04.263414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:04.263830 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:04.270458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.271153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.271930 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:04.272370 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:04.419802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:04.428621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2de12ff7-f88c-4f17-b10a-c49449fcd91c tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1576 microversion: 2.1 time: 0.170220 Jul 20 19:38:04.429277 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 608/1205] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:04 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:05.447073 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:05.447776 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:05.454271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.454724 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.455493 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:05.455930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:05.592286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:05.600534 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-03b0e6e5-c38a-4eaa-abf9-07c44ebd2a3d tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1576 microversion: 2.1 time: 0.157812 Jul 20 19:38:05.601131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 598/1206] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:05 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:06.617408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:06.618030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:06.624730 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.625220 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.626002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:06.626444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:06.859565 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:06.872156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3baea89e-9acd-4eee-a7d5-34a6333e6d92 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1576 microversion: 2.1 time: 0.258451 Jul 20 19:38:06.883679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 609/1207] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:06 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:06.995166 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-7610207d-bd84-4508-b73e-9a6a96f61f4f req-9e2bd308-3e72-4f4e-a167-fdf653467331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a7d635-c0fb-46d2-b8be-44ee48e97672", "name": "network-vif-deleted", "tag": "adb97b7c-ab6c-4cac-8466-afb36a56cddd"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:07.004602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-7610207d-bd84-4508-b73e-9a6a96f61f4f req-9e2bd308-3e72-4f4e-a167-fdf653467331 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.005939 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-7610207d-bd84-4508-b73e-9a6a96f61f4f req-9e2bd308-3e72-4f4e-a167-fdf653467331 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.018094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-7610207d-bd84-4508-b73e-9a6a96f61f4f req-9e2bd308-3e72-4f4e-a167-fdf653467331 service nova] Creating event network-vif-deleted:adb97b7c-ab6c-4cac-8466-afb36a56cddd for instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 on hv-cinder-85054 Jul 20 19:38:07.023466 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-7610207d-bd84-4508-b73e-9a6a96f61f4f req-9e2bd308-3e72-4f4e-a167-fdf653467331 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Jul 20 19:38:07.024163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 599/1208] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:07.890154 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:07.891000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:07.899421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.899912 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.900776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.901262 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.943460 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:07.945063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:07.945063 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lazy-loading 'fault' on Instance uuid c8a7d635-c0fb-46d2-b8be-44ee48e97672 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:38:07.990829 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '493d126879f44b26951920235e7f7730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1255754afb4cd384a11c87a9d717df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:07.994109 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1035407382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-428519053", "security_groups": [{"name": "tempest-secgroup-smoke-126916809"}], "networks": [{"uuid": "9b89c0a6-a46c-4abc-8170-f8b4a3cbb712"}], "block_device_mapping_v2": [{"uuid": "aae623e7-cb43-47c9-a63a-c94dd0f76bbb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:07.999095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cb931fa2-3e3d-4438-b55c-aa20fcd3b0c2 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 200 len: 1231 microversion: 2.1 time: 0.113346 Jul 20 19:38:07.999723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 610/1209] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:07 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:08.119361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] validate_networks() for [('9b89c0a6-a46c-4abc-8170-f8b4a3cbb712', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:38:08.529063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:38:08.529510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:38:08.529982 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:38:08.530390 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:38:08.530797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:38:08.540204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:08.540643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:08.541484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:08.541918 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:08.559452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Getting quotas for project f3f0c2dd35fa4890a64fcc7dcaddc633. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:38:08.563571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Getting quotas for user fc7827c5d9294b8c90f26deff983b8e3 and project f3f0c2dd35fa4890a64fcc7dcaddc633. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:38:08.620418 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:38:08.622700 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aae623e7-cb43-47c9-a63a-c94dd0f76bbb',volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:38:08.751796 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7a8daa68-2ba1-49f6-a289-73c989db42cd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761756 Jul 20 19:38:08.752594 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 600/1210] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:38:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:38:08.762812 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e5a214d0-f696-4ab1-b7bc-625ff2cb5155 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:08.763375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e5a214d0-f696-4ab1-b7bc-625ff2cb5155 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:08.821690 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e5a214d0-f696-4ab1-b7bc-625ff2cb5155 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:08.828678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e5a214d0-f696-4ab1-b7bc-625ff2cb5155 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1088 microversion: 2.1 time: 0.069811 Jul 20 19:38:08.829386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 611/1211] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:08 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:09.017600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:09.018249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: c8a7d635-c0fb-46d2-b8be-44ee48e97672] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:09.026616 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.027093 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.028211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.028657 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.044355 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] HTTP exception thrown: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Request method failure captured: Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 HTTP/1.1 Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdxUlITYk0N5dpa5vFa4rfWNNWdm8rfhfsVPa-0fwdJMsmOuhAEMKiPsteV6183Wqa0P8CCO89JTSlE0gU-N4Z3ooCbz1itIsl0dp_twtambAQSERPaJvpbreRQ3z_CGshPyMf4_Jn2BAHsta2cJHyHrj7J5kpM3zvbT3mz2App72Y Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:38:09.046060 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3f1255754afb4cd384a11c87a9d717df", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 493d126879f44b26951920235e7f7730 Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. Jul 20 19:38:09.047741 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'c8a7d635-c0fb-46d2-b8be-44ee48e97672'} Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:09.049004 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. Jul 20 19:38:09.050681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.052364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Returning 404 to user: Instance c8a7d635-c0fb-46d2-b8be-44ee48e97672 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:09.052364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b0faadd3-82ab-4bf8-a04b-0aa0b5564c66 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672" status: 404 len: 111 microversion: 2.1 time: 0.034386 Jul 20 19:38:09.052364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 601/1212] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:09 2022] GET /compute/v2.1/servers/c8a7d635-c0fb-46d2-b8be-44ee48e97672 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:09.500525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:09.501052 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:09.508508 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.508985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.509754 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.510192 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.525545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] HTTP exception thrown: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Request method failure captured: Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 HTTP/1.1 Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FdxUlITYk0N5dpa5vFa4rfWNNWdm8rfhfsVPa-0fwdJMsmOuhAEMKiPsteV6183Wqa0P8CCO89JTSlE0gU-N4Z3ooCbz1itIsl0dp_twtambAQSERPaJvpbreRQ3z_CGshPyMf4_Jn2BAHsta2cJHyHrj7J5kpM3zvbT3mz2App72Y Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:38:09.528100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3f1255754afb4cd384a11c87a9d717df", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 493d126879f44b26951920235e7f7730 Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.529826 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '000b3a8a-e2f6-4b99-b44b-add74e40f420'} Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:09.530825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.532468 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.534354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Returning 404 to user: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:09.534354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-02441614-8e77-4f3b-8415-ac8c65fff6f8 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "DELETE /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 404 len: 111 microversion: 2.1 time: 0.033271 Jul 20 19:38:09.534354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 612/1213] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:38:09 2022] DELETE /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:09.538526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:09.539411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] [instance: 000b3a8a-e2f6-4b99-b44b-add74e40f420] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:09.545570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.546048 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.546846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.547281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.560570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] HTTP exception thrown: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Request method failure captured: Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 HTTP/1.1 Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FdxUlITYk0N5dpa5vFa4rfWNNWdm8rfhfsVPa-0fwdJMsmOuhAEMKiPsteV6183Wqa0P8CCO89JTSlE0gU-N4Z3ooCbz1itIsl0dp_twtambAQSERPaJvpbreRQ3z_CGshPyMf4_Jn2BAHsta2cJHyHrj7J5kpM3zvbT3mz2App72Y Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:38:09.562136 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3f1255754afb4cd384a11c87a9d717df", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3f1255754afb4cd384a11c87a9d717df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: 3f1255754afb4cd384a11c87a9d717df Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-TestVolumeBootPattern-1531150022 Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 493d126879f44b26951920235e7f7730 Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-TestVolumeBootPattern-1531150022-project Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.563889 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '000b3a8a-e2f6-4b99-b44b-add74e40f420'} Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:09.565025 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. Jul 20 19:38:09.566549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:38:09.568832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Returning 404 to user: Instance 000b3a8a-e2f6-4b99-b44b-add74e40f420 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:09.568832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d6f19837-1fab-425a-bf3a-26d18828a8cd tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420" status: 404 len: 111 microversion: 2.1 time: 0.028917 Jul 20 19:38:09.568832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 602/1214] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:09 2022] GET /compute/v2.1/servers/000b3a8a-e2f6-4b99-b44b-add74e40f420 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:09.845083 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:09.845813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:09.852554 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.853040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.853883 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:09.854323 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:09.955739 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:09.963498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4d898a30-f3c3-449d-830f-3db950247d7d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1194 microversion: 2.1 time: 0.122330 Jul 20 19:38:09.967078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 613/1215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:09 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1194 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:10.935551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-042a90c3-2909-46c2-97bf-c4b9b58e4be9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] Calling method '.version_select at 0x7f0e85f4fd30>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:10.956316 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-042a90c3-2909-46c2-97bf-c4b9b58e4be9 tempest-TestVolumeBootPattern-1531150022 tempest-TestVolumeBootPattern-1531150022-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006792000" status: 202 len: 0 microversion: 2.1 time: 0.023932 Jul 20 19:38:10.957210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 603/1216] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 19:38:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2006792000 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:10.981494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:10.982835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:10.991169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.991636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:10.992462 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:10.992996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.236102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:11.246750 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-890f8ff8-7531-4d2f-8363-131ef39e1cf4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.269426 Jul 20 19:38:11.257803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 614/1217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:10 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:11.453919 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-59d62272-e041-404f-95d0-c0b2ac4eb0ce req-e5c4ec51-988b-4321-ade9-ae094827a12b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:11.466981 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-59d62272-e041-404f-95d0-c0b2ac4eb0ce req-e5c4ec51-988b-4321-ade9-ae094827a12b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:11.467868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-59d62272-e041-404f-95d0-c0b2ac4eb0ce req-e5c4ec51-988b-4321-ade9-ae094827a12b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:11.480844 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-59d62272-e041-404f-95d0-c0b2ac4eb0ce req-e5c4ec51-988b-4321-ade9-ae094827a12b service nova] Creating event network-changed:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:38:11.492989 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-59d62272-e041-404f-95d0-c0b2ac4eb0ce req-e5c4ec51-988b-4321-ade9-ae094827a12b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039949 Jul 20 19:38:11.493985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 604/1218] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:11.658935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:38:11.659187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Wed Jul 20 19:38:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:38:12.265178 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:12.265755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:12.273878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.274337 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.275134 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:12.275577 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:12.497173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:12.504843 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-12a8b2db-1ccd-4372-8645-af6dc057bfa0 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.243840 Jul 20 19:38:12.505819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 615/1219] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:12 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:13.524279 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:13.525357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:13.533438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.533900 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.534690 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:13.535126 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:13.919198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:13.919198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-82a3a540-2a8c-46df-997b-1bdd65c53bc5 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.399441 Jul 20 19:38:13.919198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 605/1220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:13 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:14.935786 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:14.936547 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:14.943501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.944045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:14.944906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:14.945429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:15.082762 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:15.090664 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2281364a-1ec2-4e47-889a-4583111bc745 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.158797 Jul 20 19:38:15.091234 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 616/1221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:14 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:16.108334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:16.109188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:16.115799 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:16.116319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:16.117245 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:16.117747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:16.273465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:16.281206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f3574ee4-4ad4-4ec0-a83c-45a5acc21b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.177164 Jul 20 19:38:16.282074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 606/1222] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:16 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:17.299054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:17.299702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:17.306986 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.307445 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.308237 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:17.308678 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:17.455183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:17.472119 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c0209f8f-91b8-4321-a115-9ceb259478fa tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.176863 Jul 20 19:38:17.472814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 617/1223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:17 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:18.488515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:18.489230 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:18.495760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.496212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.497015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:18.497457 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:18.548976 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:18.571704 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:18.637810 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:18.658299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ac23f916-7980-4e2b-afc7-10203b7383fb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.173500 Jul 20 19:38:18.659334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 607/1224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:18 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:19.675941 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:19.676746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:19.679066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:19.684985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.685838 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.686502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:19.686502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:19.830850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:19.838954 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a7637913-75a6-4a80-a97b-d449efbf1d52 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.166930 Jul 20 19:38:19.839518 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 618/1225] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:19 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:20.855611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:20.856258 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:20.863113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.863562 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.865010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:20.865450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:20.997352 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:21.004870 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6ae1b3a8-b87c-4fca-ac32-a85b6817505b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.153139 Jul 20 19:38:21.005490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 608/1226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:20 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:22.029269 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:22.029878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:22.037156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:22.037605 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:22.038369 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:22.039087 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:22.175911 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:22.183452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-3c78010d-45ef-46a6-b822-7015c1556b76 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.158132 Jul 20 19:38:22.184022 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 619/1227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:22 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:22.653302 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-d550b682-6086-4e92-8276-e13771b6a435 req-9f6e3750-c172-445a-866e-29314ca3a84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "name": "network-vif-plugged", "status": "completed", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:22.662671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d550b682-6086-4e92-8276-e13771b6a435 req-9f6e3750-c172-445a-866e-29314ca3a84d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:22.663124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d550b682-6086-4e92-8276-e13771b6a435 req-9f6e3750-c172-445a-866e-29314ca3a84d service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:22.674955 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-d550b682-6086-4e92-8276-e13771b6a435 req-9f6e3750-c172-445a-866e-29314ca3a84d service nova] Creating event network-vif-plugged:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:38:22.680681 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-d550b682-6086-4e92-8276-e13771b6a435 req-9f6e3750-c172-445a-866e-29314ca3a84d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Jul 20 19:38:22.681130 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 609/1228] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:23.200572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:23.201211 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:23.208766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:23.209265 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:23.210039 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:23.210489 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:23.344200 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:23.351631 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a65e19c2-93e7-4f4d-82e7-09411b260f4f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.154975 Jul 20 19:38:23.352188 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 620/1229] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:23 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:24.368873 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:24.369599 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:24.376200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.376640 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.377420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:24.377846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:24.517488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:24.526147 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-325019db-fbc7-469e-a3bc-87f0af28f621 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1259 microversion: 2.1 time: 0.162148 Jul 20 19:38:24.526740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 610/1230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:24 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:25.543525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:25.544194 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:25.550907 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.551502 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.552413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.552855 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.556933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:25.692869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:25.700600 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e3da778a-2d42-4734-a05d-2a735a01fcfe tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1444 microversion: 2.1 time: 0.160936 Jul 20 19:38:25.701399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 621/1231] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:25 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:25.718360 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:25.719020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:25.726531 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.726980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.727735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:25.728163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:25.859602 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:25.871422 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0ef82fb5-1731-4ce4-9a42-682b71696089 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1444 microversion: 2.1 time: 0.156903 Jul 20 19:38:25.872000 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 611/1232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:25 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:27.726424 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-019f292a-f659-4948-b43a-e17cddc23c65 req-e9408caa-5d84-48ef-9dc8-f7e394b0b448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:27.730583 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:27.736679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-019f292a-f659-4948-b43a-e17cddc23c65 req-e9408caa-5d84-48ef-9dc8-f7e394b0b448 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:27.737144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-019f292a-f659-4948-b43a-e17cddc23c65 req-e9408caa-5d84-48ef-9dc8-f7e394b0b448 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:27.750036 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-019f292a-f659-4948-b43a-e17cddc23c65 req-e9408caa-5d84-48ef-9dc8-f7e394b0b448 service nova] Creating event network-changed:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:38:27.755906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-019f292a-f659-4948-b43a-e17cddc23c65 req-e9408caa-5d84-48ef-9dc8-f7e394b0b448 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033326 Jul 20 19:38:27.756507 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 622/1233] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:28.252015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:28.252622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.255464 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:28.261335 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.261886 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.262924 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.263356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.268643 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:28.296610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b6f90c02-da1a-48a8-a46a-5aa8694be89b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/ips" status: 200 len: 150 microversion: 2.1 time: 0.048456 Jul 20 19:38:28.297410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 612/1234] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:38:28 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:28.308866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ed7300f-cb38-4e1c-b2d5-1198c796c897"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:28.309970 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.316985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.317451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.318244 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.318962 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.415979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: POST /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/os-volume_attachments HTTP/1.1 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 74 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:38:28.418463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {"volumeAttachment": {"volumeId": "3ed7300f-cb38-4e1c-b2d5-1198c796c897"}} Jul 20 19:38:28.420018 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'server_id': 'e3ff6a43-e269-4575-925c-2b6e4e93dabb', 'body': {'volumeAttachment': {'volumeId': '3ed7300f-cb38-4e1c-b2d5-1198c796c897'}}} Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:28.421015 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:28.422352 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 400 to user: Invalid volume: volume 3ed7300f-cb38-4e1c-b2d5-1198c796c897 is already attached to instances: 03c936cd-d435-4fb2-b37c-413b8e71ffab {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2d67068e-0828-4992-ab55-846d47160420 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115758 Jul 20 19:38:28.423673 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 623/1235] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:38:28 2022] POST /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:38:28.430086 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:28.430593 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.437332 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.437797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.438575 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.439010 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.464826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:38:28.554807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-558aa476-e3f4-4586-9eaa-46d77b8e59fc tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 204 len: 0 microversion: 2.1 time: 0.129182 Jul 20 19:38:28.555577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 613/1236] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:38:28 2022] DELETE /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:38:28.563637 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:28.564202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:28.570981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.571437 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.572213 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:28.572702 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:28.714793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:28.723096 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-00e4e4b5-93a6-483e-837a-6d195abc0684 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1682 microversion: 2.1 time: 0.163254 Jul 20 19:38:28.724624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 624/1237] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:28 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:29.742860 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:29.743565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:29.750826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:29.751271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:29.752043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:29.752475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:29.893293 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:29.900937 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-18697783-2109-4d27-a9f3-5ba3d26e84d7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1682 microversion: 2.1 time: 0.163144 Jul 20 19:38:29.901510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 614/1238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:29 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:30.919837 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:30.920453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:30.927758 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:30.928205 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:30.929024 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:30.929470 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:30.995802 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:31.003498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-2398c6c8-8327-482a-95fc-f5dc8d49778d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 200 len: 1614 microversion: 2.1 time: 0.087481 Jul 20 19:38:31.004060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 625/1239] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:30 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:31.223489 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-21a98223-2e31-460e-9ac3-4c3fb409d870 req-1b2ce82a-1742-4d85-b6b0-8d6fa9662e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ff6a43-e269-4575-925c-2b6e4e93dabb", "name": "network-vif-deleted", "tag": "8a1ad294-9718-423e-a03a-bdffabd23eb9"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:31.234259 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-21a98223-2e31-460e-9ac3-4c3fb409d870 req-1b2ce82a-1742-4d85-b6b0-8d6fa9662e4f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:31.234849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-21a98223-2e31-460e-9ac3-4c3fb409d870 req-1b2ce82a-1742-4d85-b6b0-8d6fa9662e4f service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:31.247416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-21a98223-2e31-460e-9ac3-4c3fb409d870 req-1b2ce82a-1742-4d85-b6b0-8d6fa9662e4f service nova] Creating event network-vif-deleted:8a1ad294-9718-423e-a03a-bdffabd23eb9 for instance e3ff6a43-e269-4575-925c-2b6e4e93dabb on hv-cinder-85054 Jul 20 19:38:31.252308 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-21a98223-2e31-460e-9ac3-4c3fb409d870 req-1b2ce82a-1742-4d85-b6b0-8d6fa9662e4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Jul 20 19:38:31.253169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 615/1240] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:32.022525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:32.023165 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:32.029963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.030444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.031187 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:32.031624 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:32.048698 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb HTTP/1.1 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:38:32.050185 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:38:32.052582 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'e3ff6a43-e269-4575-925c-2b6e4e93dabb'} Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:32.054175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:38:32.057055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:32.059378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:32.059378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c19ea055-36e9-4f66-a96f-2e2dbb5793de tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 404 len: 111 microversion: 2.1 time: 0.033970 Jul 20 19:38:32.059378 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 626/1241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:32 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:32.061212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-94e04b3f-aea4-4450-b588-319cf025082d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '.version_select at 0x7f0e85ebe430>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:32.080482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-94e04b3f-aea4-4450-b588-319cf025082d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855316652" status: 202 len: 0 microversion: 2.1 time: 0.023528 Jul 20 19:38:32.084839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 616/1242] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 19:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855316652 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:33.043349 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:33.043920 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:33.050785 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.051992 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.052913 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.053368 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.136466 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lazy-loading 'services' on Instance uuid 03c936cd-d435-4fb2-b37c-413b8e71ffab {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:38:33.209572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a6560bb0-2e28-415e-9bbe-b7f4a6503a82 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments/3ed7300f-cb38-4e1c-b2d5-1198c796c897" status: 202 len: 0 microversion: 2.1 time: 0.170324 Jul 20 19:38:33.210413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 627/1243] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:38:33 2022] DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments/3ed7300f-cb38-4e1c-b2d5-1198c796c897 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:33.219932 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:33.221029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:33.228814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.229313 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.230271 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:33.230714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:33.266557 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-da389870-9041-4e8f-aa55-8a0123383530 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051393 Jul 20 19:38:33.268139 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 617/1244] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:38:33 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:34.281967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:34.283044 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.291807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.292260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.293075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.293513 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.323572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dbb46d39-4aa9-436c-bf42-59ee91836f99 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045937 Jul 20 19:38:34.324135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 628/1245] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:38:34 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:38:34.381866 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:34.382477 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.389043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.390297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.391113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.391549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.419456 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:38:34.496619 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ff9aad4c-e86a-4062-956a-df534cd0c708 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 204 len: 0 microversion: 2.1 time: 0.118855 Jul 20 19:38:34.497384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 618/1246] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:38:34 2022] DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:38:34.507271 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:34.507873 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.514215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.514663 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.515432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.515866 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.654494 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:34.663120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b13574ce-c37e-4b78-8004-37f8eb72d286 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1679 microversion: 2.1 time: 0.160796 Jul 20 19:38:34.663695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 629/1247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:34 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:35.681897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:35.682674 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:35.689406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:35.689854 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:35.690629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:35.691062 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:35.825033 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:35.832673 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-680f6b2e-becf-4fa1-b2c0-1542beb020ae tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1679 microversion: 2.1 time: 0.154956 Jul 20 19:38:35.833282 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 619/1248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:35 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:36.850212 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:36.850916 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:36.858630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.859101 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.859971 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.860408 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.008777 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:37.016334 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-89cb7767-1b94-48ff-8fa2-c736cc668212 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 200 len: 1679 microversion: 2.1 time: 0.170324 Jul 20 19:38:37.016924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 630/1249] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:36 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:37.474270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-12aba774-8680-4a4c-8a64-1b5bff9274cd req-8028a016-f2fe-4a1d-b3a7-df8fcb378a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c936cd-d435-4fb2-b37c-413b8e71ffab", "name": "network-vif-deleted", "tag": "4a0cbc8c-9546-4996-abd6-a592176c93a7"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:37.484333 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-12aba774-8680-4a4c-8a64-1b5bff9274cd req-8028a016-f2fe-4a1d-b3a7-df8fcb378a91 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.484782 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-12aba774-8680-4a4c-8a64-1b5bff9274cd req-8028a016-f2fe-4a1d-b3a7-df8fcb378a91 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.497573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-12aba774-8680-4a4c-8a64-1b5bff9274cd req-8028a016-f2fe-4a1d-b3a7-df8fcb378a91 service nova] Creating event network-vif-deleted:4a0cbc8c-9546-4996-abd6-a592176c93a7 for instance 03c936cd-d435-4fb2-b37c-413b8e71ffab on hv-cinder-85054 Jul 20 19:38:37.504537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-12aba774-8680-4a4c-8a64-1b5bff9274cd req-8028a016-f2fe-4a1d-b3a7-df8fcb378a91 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 Jul 20 19:38:37.505880 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 620/1250] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:38.036733 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.038399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:38.046023 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.046558 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.047670 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.048526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.067297 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab HTTP/1.1 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:38:38.069047 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:38:38.070611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '03c936cd-d435-4fb2-b37c-413b8e71ffab'} Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:38.071399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:38:38.072704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:38:38.073924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:38.073924 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6ba7170f-be39-42fb-b725-4e32a259754d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 404 len: 111 microversion: 2.1 time: 0.038880 Jul 20 19:38:38.074428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 631/1251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:38 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:38.081413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-1072696f-9ab1-4da1-af3e-a9c511ca53d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '.version_select at 0x7f0e85e97820>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.102263 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-1072696f-9ab1-4da1-af3e-a9c511ca53d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198947595" status: 202 len: 0 microversion: 2.1 time: 0.025967 Jul 20 19:38:38.102859 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 621/1252] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 19:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198947595 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:38.759476 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-90f345d9-48e8-47c6-b2b7-745b509e27af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: .version_select at 0x7f0e85c84790>, body: {"keypair": {"name": "tempest-keypair-842797019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGvSGUwQ2nxZ/iUUz5K6MMrUWpc9bCU1/KUtyuKHYflTrtxI7UtWw3bu6F/Y0NNMzRvm92TPV0BDcxvs6TBXBvYohAt+gyxT2IqHv/DWBbxLXXZ9Wwb/vjrAalRPYOc/Q=="}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:38.773966 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-90f345d9-48e8-47c6-b2b7-745b509e27af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:38:38.778088 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-90f345d9-48e8-47c6-b2b7-745b509e27af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:38:38.800810 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-90f345d9-48e8-47c6-b2b7-745b509e27af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045163 Jul 20 19:38:38.802210 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 632/1253] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:38:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:40.143959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1821161810", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4806620-4962-4134-99b4-81d4c833434f"}], "security_groups": [{"name": "tempest-securitygroup--430715556"}], "key_name": "tempest-keypair-842797019", "user_data": "}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:40.255442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] validate_networks() for [('f4806620-4962-4134-99b4-81d4c833434f', None, None, None, None, None)] {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:38:40.698287 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:38:40.699327 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:38:40.699814 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:38:40.700231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:38:40.700646 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:38:40.710127 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.710577 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.711381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.711813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.729909 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:38:40.734022 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:38:40.745200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:38:40.747564 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:38:40.797990 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-16ed6d87-6599-4249-ad23-b6c38745b70c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661146 Jul 20 19:38:40.798638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 622/1254] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:38:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:38:40.809473 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e11c3284-801d-4023-bcbe-c13873a29db7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:40.810096 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e11c3284-801d-4023-bcbe-c13873a29db7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:40.868007 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e11c3284-801d-4023-bcbe-c13873a29db7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:40.875793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e11c3284-801d-4023-bcbe-c13873a29db7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1241 microversion: 2.1 time: 0.070655 Jul 20 19:38:40.876373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 633/1255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:40 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:41.899356 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:41.900638 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:41.912286 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.914188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.915008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.915444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.985965 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:41.995752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ba00f4da-01f4-4610-94fb-4918283996f1 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1293 microversion: 2.1 time: 0.105560 Jul 20 19:38:41.996488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 623/1256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:41 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:43.015483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:43.016833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:43.026153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:43.026611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.027399 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:43.027840 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.167335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:43.175079 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-1772e4e6-f90e-4503-980e-6e80d70c5233 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.163480 Jul 20 19:38:43.175737 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 634/1257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:43 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:43.632588 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-6e1c3dff-e981-4230-89bd-128182ba5a5e req-f7414b1a-327b-43e2-ad92-a2bf50477518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c68bca-c913-40c9-a81b-954f9592d43e", "tag": "5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:43.651836 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6e1c3dff-e981-4230-89bd-128182ba5a5e req-f7414b1a-327b-43e2-ad92-a2bf50477518 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:43.652533 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-6e1c3dff-e981-4230-89bd-128182ba5a5e req-f7414b1a-327b-43e2-ad92-a2bf50477518 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:43.666452 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-6e1c3dff-e981-4230-89bd-128182ba5a5e req-f7414b1a-327b-43e2-ad92-a2bf50477518 service nova] Creating event network-changed:5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98 for instance f5c68bca-c913-40c9-a81b-954f9592d43e on hv-cinder-85054 Jul 20 19:38:43.671825 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-6e1c3dff-e981-4230-89bd-128182ba5a5e req-f7414b1a-327b-43e2-ad92-a2bf50477518 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044943 Jul 20 19:38:43.672402 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 624/1258] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:44.191997 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:44.192644 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:44.199395 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.199845 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.200621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:44.201085 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:44.343120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:44.351477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9acd28f3-68d5-4c99-aed2-10f31fe900a6 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.163561 Jul 20 19:38:44.352142 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 635/1259] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:44 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:45.368523 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:45.369337 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:45.376853 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.377354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.378129 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:45.378590 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:45.528114 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:45.538733 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8f72f56b-8e06-4435-a59d-e3af57ba0ee7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.174077 Jul 20 19:38:45.540216 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 625/1260] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:45 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:38:46.558110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:46.558739 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:46.565344 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.565793 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.566649 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:46.567597 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:46.704149 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:46.712223 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b87edb24-67a1-4075-8375-972f7e67ec5f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.158084 Jul 20 19:38:46.712819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 636/1261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:46 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:47.728903 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:47.729539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:47.736074 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.736525 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.737318 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:47.737752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:47.878188 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:47.885876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-00b895a2-9e96-4fe5-8a97-11eddca4df84 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.160940 Jul 20 19:38:47.886458 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 626/1262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:47 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:48.797658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-bf514b5e-2d10-4df8-a3a7-25731819170c req-c1ee5775-c52b-4cbe-88b4-ab764c254bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c68bca-c913-40c9-a81b-954f9592d43e", "name": "network-vif-plugged", "status": "completed", "tag": "5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:48.808436 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-bf514b5e-2d10-4df8-a3a7-25731819170c req-c1ee5775-c52b-4cbe-88b4-ab764c254bc5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:48.809500 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-bf514b5e-2d10-4df8-a3a7-25731819170c req-c1ee5775-c52b-4cbe-88b4-ab764c254bc5 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:48.824143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-bf514b5e-2d10-4df8-a3a7-25731819170c req-c1ee5775-c52b-4cbe-88b4-ab764c254bc5 service nova] Creating event network-vif-plugged:5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98 for instance f5c68bca-c913-40c9-a81b-954f9592d43e on hv-cinder-85054 Jul 20 19:38:48.829540 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-bf514b5e-2d10-4df8-a3a7-25731819170c req-c1ee5775-c52b-4cbe-88b4-ab764c254bc5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Jul 20 19:38:48.830159 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 637/1263] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:48.903753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:48.904353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:48.911204 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:48.911653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:48.912430 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:48.912867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:49.063131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:49.072942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-81274994-650d-42a1-8cd8-e97160855f09 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.173263 Jul 20 19:38:49.073556 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 627/1264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:48 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:50.090253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:50.090953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:50.098928 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.099380 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.100172 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:50.100611 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:50.270440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:50.278414 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f35d87af-ef37-4017-b359-24c3b438ab81 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1366 microversion: 2.1 time: 0.192390 Jul 20 19:38:50.279002 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 638/1265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:50 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:51.295883 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:51.296433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:51.298849 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:51.299515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:51.305897 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.306339 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.307094 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.307541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.442312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:51.449794 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-18d888e7-34b4-4ade-903e-9acdebdc94c2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1556 microversion: 2.1 time: 0.157922 Jul 20 19:38:51.450348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 628/1266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:51 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:51.466407 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:51.466933 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:51.468836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:51.475196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.475650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.476423 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:51.476863 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:51.558658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-66cfdb09-f1df-4fa5-940a-fab98e3f411e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096091 Jul 20 19:38:51.559261 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 639/1267] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:38:51 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:52.687558 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-ca4e4314-ee11-436f-a2a5-fbb2f9a12c57 req-3e62abf4-649f-42e5-82ee-f4cf5de6e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c68bca-c913-40c9-a81b-954f9592d43e", "tag": "5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:52.697301 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-ca4e4314-ee11-436f-a2a5-fbb2f9a12c57 req-3e62abf4-649f-42e5-82ee-f4cf5de6e5e1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:52.697832 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-ca4e4314-ee11-436f-a2a5-fbb2f9a12c57 req-3e62abf4-649f-42e5-82ee-f4cf5de6e5e1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:52.715740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-ca4e4314-ee11-436f-a2a5-fbb2f9a12c57 req-3e62abf4-649f-42e5-82ee-f4cf5de6e5e1 service nova] Creating event network-changed:5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98 for instance f5c68bca-c913-40c9-a81b-954f9592d43e on hv-cinder-85054 Jul 20 19:38:52.722016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-ca4e4314-ee11-436f-a2a5-fbb2f9a12c57 req-3e62abf4-649f-42e5-82ee-f4cf5de6e5e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174571 Jul 20 19:38:52.722644 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 629/1268] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:39:36.496364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:36.497379 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:36.501722 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:36.502216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:36.511426 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:36.511878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:36.512645 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:36.513118 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:36.538167 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-ab4ad71b-c77a-4ad0-9c9f-ce84a7686a76 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/ips" status: 200 len: 150 microversion: 2.1 time: 0.043245 Jul 20 19:39:36.538748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 640/1269] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:39:36 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:39:37.861442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:37.862198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:39:37.867671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d840d202-bb79-49ca-a5ca-11cb63d476ed"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:37.868835 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:37.877270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:37.877721 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:37.878511 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:37.878949 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:38.167011 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c03c9ef1-6cb8-4d77-853d-fe8dd476a557 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307076 Jul 20 19:39:38.167665 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 630/1270] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:39:37 2022] POST /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:39:45.681428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d840d202-bb79-49ca-a5ca-11cb63d476ed"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:45.682523 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:45.689869 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.690318 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.691357 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.691658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.773878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: POST /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments HTTP/1.1 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 74 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:39:45.775623 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {"volumeAttachment": {"volumeId": "d840d202-bb79-49ca-a5ca-11cb63d476ed"}} Jul 20 19:39:45.777373 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'server_id': 'f5c68bca-c913-40c9-a81b-954f9592d43e', 'body': {'volumeAttachment': {'volumeId': 'd840d202-bb79-49ca-a5ca-11cb63d476ed'}}} Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:39:45.778501 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:45.780292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 400 to user: Invalid volume: volume d840d202-bb79-49ca-a5ca-11cb63d476ed is already attached to instances: f5c68bca-c913-40c9-a81b-954f9592d43e {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4527b268-f74e-47d0-af41-ed846e7c844d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100398 Jul 20 19:39:45.782363 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 641/1271] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:39:45 2022] POST /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:39:45.841444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:45.842019 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:45.848287 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.848807 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.849614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:45.850053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:45.929578 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lazy-loading 'services' on Instance uuid f5c68bca-c913-40c9-a81b-954f9592d43e {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:39:46.007333 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-cba8c494-eb9e-4a12-a10b-dde87a759970 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments/d840d202-bb79-49ca-a5ca-11cb63d476ed" status: 202 len: 0 microversion: 2.1 time: 0.170181 Jul 20 19:39:46.007942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 631/1272] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:39:45 2022] DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments/d840d202-bb79-49ca-a5ca-11cb63d476ed => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:39:46.022073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:46.023578 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:46.030250 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.030704 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.031571 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:46.032019 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:46.067566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a81edf82-a688-4767-934c-49e2c938494f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050553 Jul 20 19:39:46.068145 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 642/1273] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:39:46 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:39:47.080317 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:47.081411 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:47.088252 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.088707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.089544 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.089980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.119281 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d9b04c0f-2f82-4a2e-b32e-f3685392cf72 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043328 Jul 20 19:39:47.119839 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 632/1274] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:39:47 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:39:47.176276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:47.177325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:47.184074 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.184729 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.185566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.186012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.211425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:39:47.287060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-365e8470-568b-4e6f-a7e2-123a23df4029 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 204 len: 0 microversion: 2.1 time: 0.113933 Jul 20 19:39:47.287567 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 643/1275] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:39:47 2022] DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:39:47.296781 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:47.297420 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:47.304296 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.304747 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.305580 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:47.306015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:47.448945 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:47.456459 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aca7e1c3-cbcc-4fef-9d6d-5b286de7a26d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1681 microversion: 2.1 time: 0.163481 Jul 20 19:39:47.457052 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 633/1276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:47 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:48.474393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:48.475100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:48.481656 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.482108 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:48.482878 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:48.483317 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:48.878156 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:48.886882 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8090f26e-ceeb-4d64-a37e-ced35cdf4587 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1681 microversion: 2.1 time: 0.417566 Jul 20 19:39:48.887453 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 644/1277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:48 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:49.903826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:49.904373 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:49.910946 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:49.912498 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:49.913173 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:49.913609 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:49.977846 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:49.985386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-75a1b44a-bf63-4ef8-bc95-73582e25f3e7 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 200 len: 1614 microversion: 2.1 time: 0.085453 Jul 20 19:39:49.985952 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 634/1278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:49 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:50.149135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-770627f7-00d3-460a-98d9-ac93ea43fbaa req-b19b88e5-f1d3-4541-8b42-eb2c401dd258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c68bca-c913-40c9-a81b-954f9592d43e", "name": "network-vif-deleted", "tag": "5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:50.160162 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-770627f7-00d3-460a-98d9-ac93ea43fbaa req-b19b88e5-f1d3-4541-8b42-eb2c401dd258 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:50.161054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-770627f7-00d3-460a-98d9-ac93ea43fbaa req-b19b88e5-f1d3-4541-8b42-eb2c401dd258 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:50.175458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-770627f7-00d3-460a-98d9-ac93ea43fbaa req-b19b88e5-f1d3-4541-8b42-eb2c401dd258 service nova] Creating event network-vif-deleted:5414cf4b-7fa0-4037-8ca1-87ee2ccbfd98 for instance f5c68bca-c913-40c9-a81b-954f9592d43e on hv-cinder-85054 Jul 20 19:39:50.183302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-770627f7-00d3-460a-98d9-ac93ea43fbaa req-b19b88e5-f1d3-4541-8b42-eb2c401dd258 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108600 Jul 20 19:39:50.184168 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 645/1279] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:39:51.003211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:51.003858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:51.011210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.011663 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.012439 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:51.012893 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:51.027523 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e HTTP/1.1 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:39:51.029150 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:39:51.030850 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'f5c68bca-c913-40c9-a81b-954f9592d43e'} Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:39:51.035233 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:39:51.037764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:39:51.040801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:39:51.040801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-23dd8a05-c29a-4e1b-aee8-38e12473ace9 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 404 len: 111 microversion: 2.1 time: 0.031315 Jul 20 19:39:51.040801 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 635/1280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:50 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:39:51.041506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a78f5efe-8b82-4bea-b8cd-a2523f77cca5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '.version_select at 0x7f0e85977b80>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:51.060595 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a78f5efe-8b82-4bea-b8cd-a2523f77cca5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842797019" status: 202 len: 0 microversion: 2.1 time: 0.024482 Jul 20 19:39:51.061214 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 646/1281] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 19:39:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842797019 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:39:52.008350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5284c675-3b5c-47fb-b0e8-8935e2012b9b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: .version_select at 0x7f0e85d3f4c0>, body: {"keypair": {"name": "tempest-keypair-1178050619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHVijqHyM9LGNH8VbaGRsQ/6PHS3jun6Qskp5VwFRQJ1H5sRmJl5Kv3b6y3JE+nzg8l6RpHn5xLburE1XEnEPZAYo2bSGuogobXCa5X+ZLcO4wwJy7WjcFYxGRAo5uweQ=="}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:52.024571 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-5284c675-3b5c-47fb-b0e8-8935e2012b9b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:39:52.030381 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-5284c675-3b5c-47fb-b0e8-8935e2012b9b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'key_pairs'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:39:52.055408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5284c675-3b5c-47fb-b0e8-8935e2012b9b tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052869 Jul 20 19:39:52.056088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 636/1282] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 19:39:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:39:53.354380 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-752238574", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4806620-4962-4134-99b4-81d4c833434f"}], "security_groups": [{"name": "tempest-securitygroup--195458045"}], "key_name": "tempest-keypair-1178050619", "user_data": "}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:53.459096 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.network.neutron [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] validate_networks() for [('f4806620-4962-4134-99b4-81d4c833434f', None, None, None, None, None)] {{(pid=117948) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:39:53.898834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:39:53.899267 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image limits 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:39:53.899748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Flavor pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:39:53.900219 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Image pref 0:0:0 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:39:53.900633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.virt.hardware [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:39:53.909484 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.909937 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.910746 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:53.911890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:53.932857 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:39:53.936947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.quota [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Getting quotas for user 90dedb6ffa9f40fe905f60b023aeb92e and project a1bfa2d4b4084aa294fbd546ebc0f8c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117948) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:39:53.948286 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Going to run 1 instances... {{(pid=117948) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:39:53.950710 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:39:53.998756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-de5c7722-de27-4637-ac6d-e593f23d7e51 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.649223 Jul 20 19:39:53.999394 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 647/1283] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:39:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:39:54.010469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-674e26c1-d396-40ab-9f39-42727759edbf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:54.011091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-674e26c1-d396-40ab-9f39-42727759edbf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:54.078983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-674e26c1-d396-40ab-9f39-42727759edbf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:54.086434 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-674e26c1-d396-40ab-9f39-42727759edbf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1241 microversion: 2.1 time: 0.080362 Jul 20 19:39:54.087082 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 637/1284] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:54 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:55.104700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:55.105341 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:55.111683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:55.112135 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:55.112958 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:55.113401 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:55.180823 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:55.188289 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b926ac5e-bb8f-49ca-8365-0844229be715 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1293 microversion: 2.1 time: 0.087994 Jul 20 19:39:55.188850 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 648/1285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:55 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:56.205682 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:56.207410 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:56.214474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:56.214957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.215739 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:56.216178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.388471 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:56.397110 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0c9aa3e6-4c49-4876-8301-8131a59c1d78 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.195123 Jul 20 19:39:56.398264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 638/1286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:56 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:56.951442 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-886759be-8510-4468-b306-2bbfe3da1033 req-9691c3d0-25e3-475b-bf11-08d1ff35f4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00bae-fbf9-464e-9666-adb45e470f08", "tag": "00857d42-e9b4-438e-ad50-5e325ff55271"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:39:56.961051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-886759be-8510-4468-b306-2bbfe3da1033 req-9691c3d0-25e3-475b-bf11-08d1ff35f4c1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:56.961458 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-886759be-8510-4468-b306-2bbfe3da1033 req-9691c3d0-25e3-475b-bf11-08d1ff35f4c1 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:56.973329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-886759be-8510-4468-b306-2bbfe3da1033 req-9691c3d0-25e3-475b-bf11-08d1ff35f4c1 service nova] Creating event network-changed:00857d42-e9b4-438e-ad50-5e325ff55271 for instance 25c00bae-fbf9-464e-9666-adb45e470f08 on hv-cinder-85054 Jul 20 19:39:56.979196 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-886759be-8510-4468-b306-2bbfe3da1033 req-9691c3d0-25e3-475b-bf11-08d1ff35f4c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038176 Jul 20 19:39:56.979807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 649/1287] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:39:57.416450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:57.417197 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:57.423734 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.424175 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.424980 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:57.425413 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:57.560539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:57.569008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-e53dafd7-47e9-424e-afdd-c5baf426c692 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.157894 Jul 20 19:39:57.569581 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 639/1288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:57 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:58.587239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:58.588056 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:58.594498 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.594944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.595770 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:58.596146 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:58.741295 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:58.748658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-a92e8ff5-42a1-42c6-b98d-c268c7c7028f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.167089 Jul 20 19:39:58.749252 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 650/1289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:58 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:39:59.766199 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:39:59.766827 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:39:59.773629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.774076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.774851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:39:59.775269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:39:59.904815 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:39:59.912898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-947f9159-2120-4667-a5a2-78be27680394 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.150947 Jul 20 19:39:59.913473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 640/1290] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:39:59 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:00.930055 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:00.930633 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:00.937117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.937572 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:00.938346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:00.938818 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:01.074054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:01.081534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4b4d77b1-2d76-4845-99bb-64e0b39bdabf tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.156092 Jul 20 19:40:01.082173 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 651/1291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:00 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:01.189843 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-d5243f7e-7350-4ffc-940c-4c72edec60ee req-a687eefa-2a6e-4748-9a57-db9feead2019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c00bae-fbf9-464e-9666-adb45e470f08", "name": "network-vif-plugged", "status": "completed", "tag": "00857d42-e9b4-438e-ad50-5e325ff55271"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:01.198076 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d5243f7e-7350-4ffc-940c-4c72edec60ee req-a687eefa-2a6e-4748-9a57-db9feead2019 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:01.198513 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-d5243f7e-7350-4ffc-940c-4c72edec60ee req-a687eefa-2a6e-4748-9a57-db9feead2019 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:01.209771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-d5243f7e-7350-4ffc-940c-4c72edec60ee req-a687eefa-2a6e-4748-9a57-db9feead2019 service nova] Creating event network-vif-plugged:00857d42-e9b4-438e-ad50-5e325ff55271 for instance 25c00bae-fbf9-464e-9666-adb45e470f08 on hv-cinder-85054 Jul 20 19:40:01.214969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-d5243f7e-7350-4ffc-940c-4c72edec60ee req-a687eefa-2a6e-4748-9a57-db9feead2019 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095343 Jul 20 19:40:01.215699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 641/1292] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:02.098526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:02.099432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:02.105976 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:02.106435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:02.107216 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:02.107658 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:02.242248 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:02.249955 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4fd084f1-bcbe-489d-bf53-15a1950476f2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1366 microversion: 2.1 time: 0.155303 Jul 20 19:40:02.250516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 652/1293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:02 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:03.268931 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:03.269629 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:03.276179 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.276614 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.277417 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.277857 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.409526 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:03.420490 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-a7d23c4f-0cce-4745-b5ee-1c0b9aeac4e5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1555 microversion: 2.1 time: 0.156025 Jul 20 19:40:03.421586 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 642/1294] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:03 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:03.438346 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:03.439000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:03.445872 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.446364 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.447215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:03.447651 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:03.532096 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-d7708fa9-45ba-4a56-a899-5759faa0a8a2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097380 Jul 20 19:40:03.533074 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 653/1295] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 19:40:03 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:04.511539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-70fdef93-8f88-4c4d-aca6-9b30499d6f74 req-caafaf2f-2d9f-49b3-895c-3953790395c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c00bae-fbf9-464e-9666-adb45e470f08", "tag": "00857d42-e9b4-438e-ad50-5e325ff55271"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:04.515277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=6 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:04.522030 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-70fdef93-8f88-4c4d-aca6-9b30499d6f74 req-caafaf2f-2d9f-49b3-895c-3953790395c3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:04.523291 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-70fdef93-8f88-4c4d-aca6-9b30499d6f74 req-caafaf2f-2d9f-49b3-895c-3953790395c3 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:04.535913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-70fdef93-8f88-4c4d-aca6-9b30499d6f74 req-caafaf2f-2d9f-49b3-895c-3953790395c3 service nova] Creating event network-changed:00857d42-e9b4-438e-ad50-5e325ff55271 for instance 25c00bae-fbf9-464e-9666-adb45e470f08 on hv-cinder-85054 Jul 20 19:40:04.542409 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-70fdef93-8f88-4c4d-aca6-9b30499d6f74 req-caafaf2f-2d9f-49b3-895c-3953790395c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034493 Jul 20 19:40:04.543020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 643/1296] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:26.520374 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=2 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.521251 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=6 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.522820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.523527 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.528008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:26.528548 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:26.537281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.538228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.539000 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.539440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.564723 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lazy-loading 'flavor' on Instance uuid 67e24067-14b4-4dfd-93ea-3acf3fe777c2 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:40:26.640738 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c1dc5892-b1fa-48ef-a37f-f6bec6858eeb tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "POST /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2/action" status: 202 len: 0 microversion: 2.1 time: 0.120975 Jul 20 19:40:26.641360 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 654/1297] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:40:26 2022] POST /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:40:26.647506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.648384 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:26.652806 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:26.653573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:26.661963 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.662469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.664078 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:26.664514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:26.805565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:26.815312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b993adb5-6b5f-4c86-b1cf-e5a8e883ebee tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.169510 Jul 20 19:40:26.815875 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 644/1298] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:26 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:27.833931 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:27.834689 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:27.841064 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:27.841457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:27.842239 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:27.842675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:27.978763 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:27.987820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-12d4d8c0-33a8-4125-a128-4f9b75ce4048 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.158617 Jul 20 19:40:27.988393 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 655/1299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:27 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:29.005408 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:29.005957 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:29.014015 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.014469 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.015242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:29.015676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:29.155532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:29.163142 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5ee08561-387a-4f14-9275-098a0973d160 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.161633 Jul 20 19:40:29.163713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 645/1300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:29 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:30.181170 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:30.181804 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:30.188483 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.188959 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.189734 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:30.190175 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:30.324681 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:30.332410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-dba0ab8a-84b1-44c0-ab66-a98d2566da86 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.155466 Jul 20 19:40:30.333004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 656/1301] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:30 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:31.349841 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:31.351138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:31.357485 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.357927 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.358699 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:31.359329 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:31.495653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:31.503228 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-36083367-f046-4be6-a174-86f0b1fe4415 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.157349 Jul 20 19:40:31.503794 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 646/1302] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:31 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:32.522095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:32.522741 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:32.529215 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.529666 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.530452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:32.530886 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:32.672387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:32.680935 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-58f07b8d-e1cf-49f3-8404-8b8e1b146b59 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.162914 Jul 20 19:40:32.681503 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 657/1303] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:32 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:33.698735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:33.699367 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:33.705925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.706366 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.707124 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:33.707605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:33.840555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:33.848467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-86e7d1e4-c359-4e84-bddb-b0e70adf521c tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.153706 Jul 20 19:40:33.849083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 647/1304] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:33 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:34.867940 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:34.868561 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:34.875290 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:34.875778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:34.876558 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:34.877025 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:35.025028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:35.033057 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-011e4c13-9e35-40be-bbb2-39565a167a7e tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.170069 Jul 20 19:40:35.033668 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 658/1305] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:34 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:36.052053 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:36.052645 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:36.060063 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.060537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.061475 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:36.061940 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:36.199119 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:36.206674 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d282717f-2395-465a-89a7-66b3e6f628e4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.158948 Jul 20 19:40:36.207238 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 648/1306] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:36 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:37.223452 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:37.224073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:37.231078 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.231534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.232354 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:37.232820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:37.373355 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:37.380897 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-04a858dc-e6eb-483e-a5f9-3f8b030bb1c8 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.161293 Jul 20 19:40:37.382026 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 659/1307] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:37 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:38.399470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:38.400024 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:38.406498 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.406948 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.407713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:38.408193 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:38.547210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:38.555231 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-539c1b80-0f2f-4c2f-aeb0-a8a9b89c4b66 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.160278 Jul 20 19:40:38.555813 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 649/1308] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:38 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:39.571800 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:39.572434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:39.579077 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.579526 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.580307 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:39.580748 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:39.729683 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:39.737798 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-249ad30f-7075-4518-81f3-c76337ecc91f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.169926 Jul 20 19:40:39.738493 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 660/1309] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:39 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:40.758158 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:40.758959 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:40.765429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.765876 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.766642 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.767072 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.902442 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:40.910056 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-dc06affe-23f6-4a3d-9eb3-9c213a52462d tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1508 microversion: 2.1 time: 0.156412 Jul 20 19:40:40.910622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 650/1310] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:40 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:40.927432 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:40.928792 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:40.935111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.935551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:40.936308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:40.936738 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:41.019073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-17b44dcc-a266-4b26-bc5b-17167464bb7f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "POST /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2/action" status: 202 len: 0 microversion: 2.1 time: 0.095193 Jul 20 19:40:41.019775 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 661/1311] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 19:40:40 2022] POST /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:40:41.028174 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:41.028777 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:41.034798 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:41.035242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:41.036037 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:41.036465 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:41.190985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:41.200183 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-aae69ade-c44f-4202-aaa9-c7344181ca12 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1516 microversion: 2.1 time: 0.175839 Jul 20 19:40:41.200858 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 651/1312] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:41 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:42.217963 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:42.218525 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:42.225747 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.226204 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.226985 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.227463 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.358686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:42.367281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-71922b88-6bfd-4c23-bd0a-7c19d331c93b tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1518 microversion: 2.1 time: 0.153320 Jul 20 19:40:42.367890 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 662/1313] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:42 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:42.500068 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:42.500570 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:42.506898 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.508242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.509043 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:42.509521 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:42.534427 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-46547de7-dd8e-4565-8470-41d59dec441c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/ips" status: 200 len: 149 microversion: 2.1 time: 0.038190 Jul 20 19:40:42.534992 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 652/1314] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:40:42 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:43.302075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-5e778b1e-f36a-4567-8172-afdaccbc22ae req-7be6afce-52ef-4bc3-8f5b-6e59bcf05276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:43.311981 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5e778b1e-f36a-4567-8172-afdaccbc22ae req-7be6afce-52ef-4bc3-8f5b-6e59bcf05276 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.312264 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-5e778b1e-f36a-4567-8172-afdaccbc22ae req-7be6afce-52ef-4bc3-8f5b-6e59bcf05276 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.324639 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-5e778b1e-f36a-4567-8172-afdaccbc22ae req-7be6afce-52ef-4bc3-8f5b-6e59bcf05276 service nova] Creating event network-vif-unplugged:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:40:43.331715 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-5e778b1e-f36a-4567-8172-afdaccbc22ae req-7be6afce-52ef-4bc3-8f5b-6e59bcf05276 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032817 Jul 20 19:40:43.333070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 663/1315] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:43.385788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:43.385788 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:43.392083 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.392530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.393319 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.393797 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.536671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:43.545170 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f0de8f27-6ce8-4544-a6f3-ee97e99b0db3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.164271 Jul 20 19:40:43.545762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 653/1316] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:43 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:43.904409 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff7f4019-fa61-4cbb-adb8-4863ea7d3076"}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:43.905573 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:43.911835 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.912281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:43.913084 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:43.913730 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.264472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-09ff73cc-aa69-4134-9427-a03259240a9e tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "POST /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364209 Jul 20 19:40:44.265179 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 664/1317] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 19:40:43 2022] POST /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:44.564504 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:44.565325 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:44.572604 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.573101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.573877 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:44.574314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:44.708260 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:44.723908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b05894aa-f707-447e-99f0-9d0011902952 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.163741 Jul 20 19:40:44.724491 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 654/1318] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:44 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:45.742783 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:45.743516 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:45.750035 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.750756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.751522 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:45.751984 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:45.889994 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:45.898073 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-4757afc9-ae12-4189-8bca-32eb6c37f8c7 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.159962 Jul 20 19:40:45.898701 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 665/1319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:45 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:46.916249 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:46.916869 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:46.923473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:46.923925 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:46.924694 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:46.925160 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:47.062191 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:47.070479 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-6b7c9fca-579b-464d-bd85-355f13555d4a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.158433 Jul 20 19:40:47.071148 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 655/1320] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:46 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:48.087877 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:48.088630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:48.095803 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.096275 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.097117 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:48.097563 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:48.243443 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:48.247042 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:48.251953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cb71bebc-fbbd-4fe3-a8fc-8a7cf8e50b6a tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.168040 Jul 20 19:40:48.252537 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 666/1321] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:48 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:49.269905 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:49.270600 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:49.277510 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.277956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.278720 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:49.279159 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:49.416044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:49.423507 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-47f6a7c1-e56e-49ae-a5d9-18d93bc86c5f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.158324 Jul 20 19:40:49.424067 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 656/1322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:49 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:50.441411 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:50.442028 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:50.449336 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.449796 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.450757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:50.451021 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:50.588531 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:50.596143 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-af3a32ec-e912-4452-b434-e64b057dec67 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.159525 Jul 20 19:40:50.596721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 667/1323] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:50 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:51.614001 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:51.614845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:51.621717 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.622270 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.623107 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.623601 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.772181 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:51.781051 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b7f4b421-c89b-4974-8ae2-1cf2b5a5c1d9 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1574 microversion: 2.1 time: 0.171367 Jul 20 19:40:51.781627 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 657/1324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:51 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:51.870383 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:51.870979 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:51.882221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.882834 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.883641 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:51.884076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:51.965485 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.objects.instance [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lazy-loading 'services' on Instance uuid 25c00bae-fbf9-464e-9666-adb45e470f08 {{(pid=117948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:40:52.045285 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-68c6e72e-9d28-4b2a-bb4b-fa6d1dccea2c tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments/ff7f4019-fa61-4cbb-adb8-4863ea7d3076" status: 202 len: 0 microversion: 2.1 time: 0.172587 Jul 20 19:40:52.049211 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 668/1325] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 19:40:51 2022] DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments/ff7f4019-fa61-4cbb-adb8-4863ea7d3076 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:40:52.056443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:52.057482 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:52.063592 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.064242 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:52.064803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.065275 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:52.098930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-45a07aee-cb20-4c65-ba52-05df1006f388 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Jul 20 19:40:52.099500 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 658/1326] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:40:52 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:52.804431 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:52.806111 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:52.815478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.816008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:52.816807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:52.817278 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:53.001048 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:53.009514 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-745673f2-fe74-41b8-a5aa-b47dedb012fd tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1561 microversion: 2.1 time: 0.213914 Jul 20 19:40:53.010130 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 669/1327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:52 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:53.111474 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:53.112443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:53.121344 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:53.122113 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:53.123605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:53.124499 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:53.161580 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b8f06f42-d42e-4117-af78-17862b55729d tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054080 Jul 20 19:40:53.162156 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 659/1328] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:40:53 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:54.043060 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-c88f633e-9ebe-4ae5-8ab5-512b4865c91d req-133c8b21-ecd7-4b7a-a553-5c92e7535ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "name": "network-vif-plugged", "status": "completed", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:54.052435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c88f633e-9ebe-4ae5-8ab5-512b4865c91d req-133c8b21-ecd7-4b7a-a553-5c92e7535ab8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.052906 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c88f633e-9ebe-4ae5-8ab5-512b4865c91d req-133c8b21-ecd7-4b7a-a553-5c92e7535ab8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.065174 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-c88f633e-9ebe-4ae5-8ab5-512b4865c91d req-133c8b21-ecd7-4b7a-a553-5c92e7535ab8 service nova] Creating event network-vif-plugged:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:40:54.070151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-c88f633e-9ebe-4ae5-8ab5-512b4865c91d req-133c8b21-ecd7-4b7a-a553-5c92e7535ab8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031391 Jul 20 19:40:54.070766 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 670/1329] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:54.175520 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:54.176481 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:54.183116 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.183567 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.184357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.184771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.211438 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=100 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:54.216506 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-36a33888-32ad-40ce-bd93-04a2b9d783b5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045043 Jul 20 19:40:54.217166 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 660/1330] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 19:40:54 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:40:54.277736 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:54.278328 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:54.286464 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.286989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.287772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.288235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.316095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:40:54.399150 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8874d0ef-7e0d-4306-9502-3b79d9c53940 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 204 len: 0 microversion: 2.1 time: 0.126548 Jul 20 19:40:54.402968 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 671/1331] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:40:54 2022] DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:40:54.408515 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:54.409264 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:54.415865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.416312 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.417112 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:54.417549 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:54.555762 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:54.563364 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4d2b09d6-ef99-4c1c-999b-7c9bafde24ee tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1680 microversion: 2.1 time: 0.159129 Jul 20 19:40:54.563934 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 661/1332] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:54 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:55.581772 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:55.582467 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:55.589613 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.590054 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.590817 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:55.591247 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:55.726784 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:55.734630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-bc169773-f47f-4c6b-8b77-b55090faabd2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1680 microversion: 2.1 time: 0.157091 Jul 20 19:40:55.735202 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 672/1333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:55 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:56.751684 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:56.752353 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:56.755008 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=37 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:56.761398 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.761977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:56.762856 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:56.763369 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.002622 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:57.010555 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8299024b-6f02-4914-b3a2-508db4c6f444 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1680 microversion: 2.1 time: 0.262734 Jul 20 19:40:57.011138 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 662/1334] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:56 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:40:57.580403 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-c09ee399-0733-439e-91d0-86295e96dae8 req-19be56ca-7f2e-438f-bcac-de0f177919ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c00bae-fbf9-464e-9666-adb45e470f08", "name": "network-vif-deleted", "tag": "00857d42-e9b4-438e-ad50-5e325ff55271"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:40:57.584420 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:40:57.591365 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c09ee399-0733-439e-91d0-86295e96dae8 req-19be56ca-7f2e-438f-bcac-de0f177919ec service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:57.591755 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c09ee399-0733-439e-91d0-86295e96dae8 req-19be56ca-7f2e-438f-bcac-de0f177919ec service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:57.604944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-c09ee399-0733-439e-91d0-86295e96dae8 req-19be56ca-7f2e-438f-bcac-de0f177919ec service nova] Creating event network-vif-deleted:00857d42-e9b4-438e-ad50-5e325ff55271 for instance 25c00bae-fbf9-464e-9666-adb45e470f08 on hv-cinder-85054 Jul 20 19:40:57.610089 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-c09ee399-0733-439e-91d0-86295e96dae8 req-19be56ca-7f2e-438f-bcac-de0f177919ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Jul 20 19:40:57.613646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 673/1335] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:40:58.028374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:58.029153 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:58.035486 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.035942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.036715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.037184 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.069403 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:58.070416 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:58.071163 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lazy-loading 'fault' on Instance uuid 25c00bae-fbf9-464e-9666-adb45e470f08 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:40:58.112573 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dedb6ffa9f40fe905f60b023aeb92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bfa2d4b4084aa294fbd546ebc0f8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:40:58.120865 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f6d22b29-08e0-44ff-b23c-809d1fa1dced tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 200 len: 1331 microversion: 2.1 time: 0.096376 Jul 20 19:40:58.121472 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 663/1336] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:58 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:40:59.139425 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:59.140129 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:40:59.146472 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:59.146926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:59.147705 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:40:59.148686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:40:59.161858 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 HTTP/1.1 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:40:59.163492 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:40:59.165880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '25c00bae-fbf9-464e-9666-adb45e470f08'} Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:40:59.166721 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:40:59.168276 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:40:59.169778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:40:59.169778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6db99e76-9d1e-4970-a776-fe8bc0344832 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 404 len: 111 microversion: 2.1 time: 0.031664 Jul 20 19:40:59.169778 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 674/1337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:40:59 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:40:59.175169 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-882cfeed-24c3-407f-9788-213c4272c55f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '.version_select at 0x7f0e85da9dc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:40:59.193123 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-882cfeed-24c3-407f-9788-213c4272c55f tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178050619" status: 202 len: 0 microversion: 2.1 time: 0.021662 Jul 20 19:40:59.193712 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 664/1338] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 19:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178050619 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:41:00.989180 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:00.989756 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:00.996478 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:00.996967 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:00.997743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:00.998186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.014444 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 HTTP/1.1 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:41:01.015993 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.017562 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '25c00bae-fbf9-464e-9666-adb45e470f08'} Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:01.018421 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.020207 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.021833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:01.021833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-7a8ef4f7-d7bd-49da-9d9c-d75fc40e0f21 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 404 len: 111 microversion: 2.1 time: 0.032044 Jul 20 19:41:01.021833 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 675/1339] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:41:00 2022] DELETE /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:01.027064 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:01.027707 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 25c00bae-fbf9-464e-9666-adb45e470f08] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:01.035044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.035473 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.036255 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:01.036713 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:01.049956 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 HTTP/1.1 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:41:01.051679 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.053386 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '25c00bae-fbf9-464e-9666-adb45e470f08'} Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:01.054388 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. Jul 20 19:41:01.056206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:01.057636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 25c00bae-fbf9-464e-9666-adb45e470f08 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:01.057636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-abc40fa1-3b5f-4cb1-9877-51e4e3784bef tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08" status: 404 len: 111 microversion: 2.1 time: 0.030877 Jul 20 19:41:01.057636 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 665/1340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:01 2022] GET /compute/v2.1/servers/25c00bae-fbf9-464e-9666-adb45e470f08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:02.189418 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.189944 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.196588 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.197069 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.197832 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.198263 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.212551 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e HTTP/1.1 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:41:02.214141 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.216260 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'f5c68bca-c913-40c9-a81b-954f9592d43e'} Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:02.217428 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.219040 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.220545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:02.220545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-b27e61e1-9024-4afc-8510-f6e27901ab02 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 404 len: 111 microversion: 2.1 time: 0.030188 Jul 20 19:41:02.220545 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 676/1341] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:41:02 2022] DELETE /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:02.224361 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.225005 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: f5c68bca-c913-40c9-a81b-954f9592d43e] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.233222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.233716 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.234514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.234977 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.250530 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e HTTP/1.1 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:41:02.252057 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.253771 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'f5c68bca-c913-40c9-a81b-954f9592d43e'} Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:02.254610 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. Jul 20 19:41:02.256187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.257920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance f5c68bca-c913-40c9-a81b-954f9592d43e could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:02.257920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-4f39459d-a07c-4ee8-b63e-b513fc994418 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e" status: 404 len: 111 microversion: 2.1 time: 0.033136 Jul 20 19:41:02.257920 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 666/1342] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:02 2022] GET /compute/v2.1/servers/f5c68bca-c913-40c9-a81b-954f9592d43e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:02.262076 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.262571 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.268961 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.269281 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.270042 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.270475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.284440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb HTTP/1.1 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:41:02.285999 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.287752 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'e3ff6a43-e269-4575-925c-2b6e4e93dabb'} Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:02.293008 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.295043 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.296953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:02.296953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-f7170489-1591-41ce-b5b3-2c706f9c5cc5 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 404 len: 111 microversion: 2.1 time: 0.029081 Jul 20 19:41:02.296953 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 677/1343] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:41:02 2022] DELETE /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:02.299042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:02.300206 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: e3ff6a43-e269-4575-925c-2b6e4e93dabb] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:02.308088 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.308542 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.309357 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:02.309817 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:02.323680 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb HTTP/1.1 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:41:02.325251 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.326913 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': 'e3ff6a43-e269-4575-925c-2b6e4e93dabb'} Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:02.327752 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. Jul 20 19:41:02.329143 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:02.330565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance e3ff6a43-e269-4575-925c-2b6e4e93dabb could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:02.330565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-efb6fc3f-a4d1-4a11-9a1c-c8d63adec4af tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb" status: 404 len: 111 microversion: 2.1 time: 0.033461 Jul 20 19:41:02.330565 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 667/1344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:02 2022] GET /compute/v2.1/servers/e3ff6a43-e269-4575-925c-2b6e4e93dabb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:03.460541 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:03.461169 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:03.467707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.468158 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.468956 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.469396 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.483329 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab HTTP/1.1 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:41:03.484870 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.486506 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '03c936cd-d435-4fb2-b37c-413b8e71ffab'} Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:03.487422 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.488983 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.490505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:03.490505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-876a05c5-4599-4ef4-af05-b497f1e432d2 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jul 20 19:41:03.490505 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 678/1345] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:41:03 2022] DELETE /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:03.495677 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:03.496299 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] [instance: 03c936cd-d435-4fb2-b37c-413b8e71ffab] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:41:03.502885 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.503334 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.504101 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:41:03.504532 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:41:03.518151 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] HTTP exception thrown: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Request method failure captured: Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab HTTP/1.1 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2Fk0bkmgWv6X02BqoCvFZt0NPj50Bc7tz4kW0Ra_NnYN4BSj55jPak0eY2wAxj3CjKbfYzDw58h52fTS7d6pNDbX5KtJKotjkJ1EwFwbQKiEFz_M2J2SBtEc-n69lXWaushOEmxa7Soat9FJjJ7y1jEE0tTZA8ox8X6gEO7uI8rXosc Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:41:03.519696 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a1bfa2d4b4084aa294fbd546ebc0f8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a1bfa2d4b4084aa294fbd546ebc0f8c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: a1bfa2d4b4084aa294fbd546ebc0f8c5 Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-197584479 Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: 90dedb6ffa9f40fe905f60b023aeb92e Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-AttachVolumeNegativeTest-197584479-project Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.521391 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '03c936cd-d435-4fb2-b37c-413b8e71ffab'} Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:03.522395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. Jul 20 19:41:03.524210 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:41:03.525715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] Returning 404 to user: Instance 03c936cd-d435-4fb2-b37c-413b8e71ffab could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:03.525715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-628cce46-bc64-48c2-ba21-b95916e42048 tempest-AttachVolumeNegativeTest-197584479 tempest-AttachVolumeNegativeTest-197584479-project] 10.222.0.79 "GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab" status: 404 len: 111 microversion: 2.1 time: 0.030180 Jul 20 19:41:03.525715 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 668/1346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:41:03 2022] GET /compute/v2.1/servers/03c936cd-d435-4fb2-b37c-413b8e71ffab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:08.023646 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9f0a53c6-448f-4db8-a75e-f29379ada527 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Action: 'create', calling method: .version_select at 0x7f0e85918940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-201499224", "metadata": {"Type": "work"}}} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:41:08.331996 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9f0a53c6-448f-4db8-a75e-f29379ada527 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.448181 Jul 20 19:41:08.332773 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 679/1347] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 19:41:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:41:08.343498 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-7a0c7fa0-041d-460d-a8a9-e80b962a1f64 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e85ceddc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:08.401253 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-7a0c7fa0-041d-460d-a8a9-e80b962a1f64 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 200 len: 352 microversion: 2.1 time: 0.061339 Jul 20 19:41:08.401834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 669/1348] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:41:08 2022] GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:41:09.414910 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-fec46f00-56b9-4c99-a584-9cf43ef20c5b tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e8592b8b0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.460095 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-fec46f00-56b9-4c99-a584-9cf43ef20c5b tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 200 len: 353 microversion: 2.1 time: 0.050046 Jul 20 19:41:09.461335 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 680/1349] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:41:09 2022] GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:41:09.472611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-06ad2f38-6974-465f-9774-c06814a7ed69 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e85d97940>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.518824 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-06ad2f38-6974-465f-9774-c06814a7ed69 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 200 len: 353 microversion: 2.1 time: 0.050441 Jul 20 19:41:09.519426 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 670/1350] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:41:09 2022] GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:41:09.536240 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-6d79cb92-3d65-4b49-9314-a80e81cb9e46 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e85940c10>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.598376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-6d79cb92-3d65-4b49-9314-a80e81cb9e46 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 202 len: 0 microversion: 2.1 time: 0.066258 Jul 20 19:41:09.598950 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 681/1351] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 19:41:09 2022] DELETE /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:41:09.606867 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-8519c835-d179-4b92-9c66-a5a01a8dd55b tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e86865dc0>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:09.654993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-8519c835-d179-4b92-9c66-a5a01a8dd55b tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 200 len: 352 microversion: 2.1 time: 0.051792 Jul 20 19:41:09.655519 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 671/1352] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:41:09 2022] GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:41:10.669325 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e47d0a24-dc25-4c79-b890-fda881115472 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Calling method '.version_select at 0x7f0e859695e0>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:41:10.696686 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-e47d0a24-dc25-4c79-b890-fda881115472 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] HTTP exception thrown: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e47d0a24-dc25-4c79-b890-fda881115472 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Request method failure captured: Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d HTTP/1.1 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FpTG30qaxXx5lqzSyJJbiswGIEwcYvKoxpdFbqOdX9DvIie0noXei77megVIfEPAguHEFTJjTj6lp9oYGz5OXoERTdOjpQdczOzIIapkitmkAB4Ub8AjxKTaZ6OlDcK0OP0nAG5yZrYgrO-tVDRwirF2RsCS7iwtbjN-ccot428WO8 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 23d533381be34e12a89706bbed8f6f92 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesGetTestJSON-692115010 Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:41:10.698650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/23d533381be34e12a89706bbed8f6f92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_23d533381be34e12a89706bbed8f6f92", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/23d533381be34e12a89706bbed8f6f92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/23d533381be34e12a89706bbed8f6f92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesGetTestJSON-692115010 Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 23d533381be34e12a89706bbed8f6f92 Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesGetTestJSON-692115010 Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesGetTestJSON-692115010-project Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: 3a8e26ee0fac413c9ca67ff56b6a6eb7 Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesGetTestJSON-692115010-project Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': '5131c4da-bdf9-4621-93ab-7f5ae6f2628d'} Jul 20 19:41:10.700435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. (HTTP 404) (Request-ID: req-e895449b-654f-4953-b5e1-0796609a2795) Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:10.701457 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:41:10.703302 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:41:10.704820 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e47d0a24-dc25-4c79-b890-fda881115472 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] Returning 404 to user: Volume 5131c4da-bdf9-4621-93ab-7f5ae6f2628d could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e47d0a24-dc25-4c79-b890-fda881115472 tempest-VolumesGetTestJSON-692115010 tempest-VolumesGetTestJSON-692115010-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d" status: 404 len: 109 microversion: 2.1 time: 0.036383 Jul 20 19:41:10.706791 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 682/1353] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 19:41:10 2022] GET /compute/v2.1/os-volumes/5131c4da-bdf9-4621-93ab-7f5ae6f2628d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:41:23.584376 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:41:23.585611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:10.748589 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:10.749374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell1:SELECT=28 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:10.753605 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1612333459", "imageRef": "9adb5526-2432-49c9-8807-4c4fc564a5bd", "flavorRef": "452"}} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:10.803366 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.network.neutron [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] validate_networks() for None {{(pid=117949) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:42:11.075845 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Flavor limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:42:11.076269 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Image limits 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:42:11.076751 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Flavor pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:42:11.077200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Image pref 0:0:0 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:42:11.077611 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.virt.hardware [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:42:11.086514 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.086965 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.087763 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:11.088195 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:11.105930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Getting quotas for project 67f87e7aec9f4fa7a23ba9ea65d2d733. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:42:11.109803 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.quota [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Getting quotas for user f9038a6d909342fb979b2a42534ff93e and project 67f87e7aec9f4fa7a23ba9ea65d2d733. Resources: {'cores', 'ram', 'instances'} {{(pid=117949) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:42:11.120572 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Going to run 1 instances... {{(pid=117949) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:42:11.122983 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9adb5526-2432-49c9-8807-4c4fc564a5bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:42:11.167157 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d64dce90-80f4-4925-a195-81a8fc6464d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420886 Jul 20 19:42:11.168993 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 672/1354] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 19:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:42:11.176441 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_api:SELECT=11 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:11.177695 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:11.184413 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-9dfbf171-1062-4cb2-a06d-d241b54f19a2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:11.184847 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-9dfbf171-1062-4cb2-a06d-d241b54f19a2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:11.241375 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-9dfbf171-1062-4cb2-a06d-d241b54f19a2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:11.248429 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-9dfbf171-1062-4cb2-a06d-d241b54f19a2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1215 microversion: 2.1 time: 0.073973 Jul 20 19:42:11.249090 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 683/1355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:11 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:12.266651 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-3efa89e9-c75a-44c9-9755-210060fbfecb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:12.267261 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-3efa89e9-c75a-44c9-9755-210060fbfecb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:12.322034 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-3efa89e9-c75a-44c9-9755-210060fbfecb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:12.329267 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-3efa89e9-c75a-44c9-9755-210060fbfecb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1215 microversion: 2.1 time: 0.067110 Jul 20 19:42:12.329818 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 673/1356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:12 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:13.345926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-90c8b251-6895-410c-b186-787405491ff9 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:13.346535 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-90c8b251-6895-410c-b186-787405491ff9 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:13.402051 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-90c8b251-6895-410c-b186-787405491ff9 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:13.409030 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-90c8b251-6895-410c-b186-787405491ff9 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1215 microversion: 2.1 time: 0.066890 Jul 20 19:42:13.409593 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 684/1357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:13 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:14.426820 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-d4c5b7a4-bc86-404e-b71c-7368e55d31b0 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:14.427425 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-d4c5b7a4-bc86-404e-b71c-7368e55d31b0 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:14.480735 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-d4c5b7a4-bc86-404e-b71c-7368e55d31b0 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:14.487470 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-d4c5b7a4-bc86-404e-b71c-7368e55d31b0 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1215 microversion: 2.1 time: 0.065491 Jul 20 19:42:14.488212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 674/1358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:14 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:15.504621 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:15.505243 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:15.513776 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:15.514230 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:15.515012 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:15.515481 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:15.576439 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:15.584151 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-951e2053-7c18-475d-8df4-1df30d38abf2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1219 microversion: 2.1 time: 0.083352 Jul 20 19:42:15.584716 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 685/1359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:15 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:16.601916 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:16.603248 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:16.611710 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.611915 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.613016 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.613171 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.748342 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:16.756592 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-f0ddfa0a-0119-4ab6-a17f-d327ef93fa31 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1273 microversion: 2.1 time: 0.159716 Jul 20 19:42:16.757241 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 675/1360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:16 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:16.811926 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:16.812435 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:16.819386 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.825664 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-cf9907f3-9138-48a4-978c-d14fd99fdc4f req-02e7508d-1ff3-4af9-baf9-9670353c0fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:16.830743 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.831988 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.832440 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.841444 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-cf9907f3-9138-48a4-978c-d14fd99fdc4f req-02e7508d-1ff3-4af9-baf9-9670353c0fd8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.841885 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-cf9907f3-9138-48a4-978c-d14fd99fdc4f req-02e7508d-1ff3-4af9-baf9-9670353c0fd8 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.863450 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-cf9907f3-9138-48a4-978c-d14fd99fdc4f req-02e7508d-1ff3-4af9-baf9-9670353c0fd8 service nova] Creating event network-changed:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:42:16.874939 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-cf9907f3-9138-48a4-978c-d14fd99fdc4f req-02e7508d-1ff3-4af9-baf9-9670353c0fd8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053542 Jul 20 19:42:16.875722 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 676/1361] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:42:16.880362 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Going to try to terminate instance {{(pid=117948) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:42:16.970475 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-903dc8f1-651d-4210-9190-e073f9eaf262 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 204 len: 0 microversion: 2.1 time: 0.162631 Jul 20 19:42:16.971700 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 686/1362] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:42:16 2022] DELETE /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:42:16.981085 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:16.981539 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:16.988495 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.989021 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:16.989950 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:16.990395 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.243314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:17.253168 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-b076db3e-ecae-4085-99a4-c899139d60a3 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.277302 Jul 20 19:42:17.253868 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 677/1363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:16 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:17.773544 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:17.774245 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:17.781153 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.781601 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.782376 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:17.782807 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:17.918098 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:17.925675 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-06b7f330-25d0-4ba7-bc56-7d52fac601bd tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.156401 Jul 20 19:42:17.926236 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 687/1364] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:17 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:18.272165 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:18.272864 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:18.279930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.280550 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.281350 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.281972 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.504484 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:18.512272 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-ab6ebc7e-8eee-440f-83a7-156b036d8ef4 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1567 microversion: 2.1 time: 0.244723 Jul 20 19:42:18.512848 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 678/1365] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:18 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:18.943253 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-95276cf3-7cd3-4e3d-ba7d-f7dc1b58c6aa req-865a14cc-60a4-4761-b5c1-d4c6115e3e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1", "tag": "50092e59-4883-423d-b2a1-0aa056a89899"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:18.943911 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:18.944187 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:18.959237 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.961467 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.962568 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.962713 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-95276cf3-7cd3-4e3d-ba7d-f7dc1b58c6aa req-865a14cc-60a4-4761-b5c1-d4c6115e3e9b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:18.963144 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-95276cf3-7cd3-4e3d-ba7d-f7dc1b58c6aa req-865a14cc-60a4-4761-b5c1-d4c6115e3e9b service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.963671 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:18.985709 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-95276cf3-7cd3-4e3d-ba7d-f7dc1b58c6aa req-865a14cc-60a4-4761-b5c1-d4c6115e3e9b service nova] Creating event network-changed:50092e59-4883-423d-b2a1-0aa056a89899 for instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 on hv-cinder-85054 Jul 20 19:42:18.997679 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-95276cf3-7cd3-4e3d-ba7d-f7dc1b58c6aa req-865a14cc-60a4-4761-b5c1-d4c6115e3e9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057822 Jul 20 19:42:18.998650 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 688/1366] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:42:19.531066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:19.531813 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:19.538137 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.538592 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.539372 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:19.539814 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:19.559935 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:19.568042 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-43128002-48e7-43ad-9c6e-dacb3276afbe tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.628855 Jul 20 19:42:19.568761 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 679/1367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:18 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:19.820566 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:19.828228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e8698e35-4e50-4b74-80ef-b29826feae81 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1450 microversion: 2.1 time: 0.301728 Jul 20 19:42:19.828819 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 689/1368] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:19 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1450 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:20.585727 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:20.586354 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:20.593029 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.593433 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.594198 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.594637 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.727348 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:20.735659 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-fc99a0bb-d647-4279-8b9f-c2ae9e2e455b tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.153754 Jul 20 19:42:20.736222 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 680/1369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:20 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:20.845488 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:20.846292 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:20.852825 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.853465 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.855004 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:20.855836 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:20.937529 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7827c5d9294b8c90f26deff983b8e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3f0c2dd35fa4890a64fcc7dcaddc633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:20.945045 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e88e015c-7d9a-4caa-ba4e-0a4990f03044 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 200 len: 1219 microversion: 2.1 time: 0.103616 Jul 20 19:42:20.945628 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 690/1370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:20 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:21.033714 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [req-9b259426-9c21-4b46-9458-1eaed36f0284 req-1a3b0fd5-f5e1-4529-8547-1b68cf1e204e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e24067-14b4-4dfd-93ea-3acf3fe777c2", "name": "network-vif-deleted", "tag": "3cb27c30-2f2b-4e29-97fe-211854c955e8"}]} {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:21.042851 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9b259426-9c21-4b46-9458-1eaed36f0284 req-1a3b0fd5-f5e1-4529-8547-1b68cf1e204e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.043297 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [req-9b259426-9c21-4b46-9458-1eaed36f0284 req-1a3b0fd5-f5e1-4529-8547-1b68cf1e204e service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.053987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.compute.server_external_events [req-9b259426-9c21-4b46-9458-1eaed36f0284 req-1a3b0fd5-f5e1-4529-8547-1b68cf1e204e service nova] Creating event network-vif-deleted:3cb27c30-2f2b-4e29-97fe-211854c955e8 for instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 on hv-cinder-85054 Jul 20 19:42:21.059706 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [req-9b259426-9c21-4b46-9458-1eaed36f0284 req-1a3b0fd5-f5e1-4529-8547-1b68cf1e204e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030526 Jul 20 19:42:21.060374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 681/1371] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:42:21.752553 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:21.753183 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:21.759312 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.759771 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.760534 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.761059 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.890947 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:21.898647 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-c68b87ad-ce30-4d5c-bac1-62ba390ea62a tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.150046 Jul 20 19:42:21.899225 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 691/1372] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:21 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:21.960069 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=2 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:21.965443 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:21.966152 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [instance: 67e24067-14b4-4dfd-93ea-3acf3fe777c2] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:21.972740 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.973208 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.973969 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:21.974406 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:21.987454 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.wsgi [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] HTTP exception thrown: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Request method failure captured: Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: request: GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 HTTP/1.1 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept: application/json Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Accept-Encoding: identity Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Connection: close Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Length: 0 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Content-Type: application/json Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Host: 10.222.0.79 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Openstack-System-Scope: None Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: User-Agent: python-urllib3/1.26.9 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Auth-Token: gAAAAABi2FmIeozeoW8ey0qWBQ2dl2m4VnhhrU1SzOS5SbbGt_WXiJ7Oo1m_k1qcZfh7wGKLZqSJI8NQ2eemMCLi6NDB-PXQnl0zDri0OihSijWi0D4kRgVH5r7bLbTBrpWCNZC5GznATyLFtsX-reqPUHACM8UEMKaev2Ab1dM3qtUFC_NY0Zs Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Id: None Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Domain-Name: None Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Identity-Status: Confirmed Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Is-Admin-Project: True Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Id: default Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Domain-Name: Default Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Id: f3f0c2dd35fa4890a64fcc7dcaddc633 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Project-Name: tempest-TestShelveInstance-1213112724 Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Role: reader,member Jul 20 19:42:21.989091 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Roles: reader,member Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f3f0c2dd35fa4890a64fcc7dcaddc633"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f3f0c2dd35fa4890a64fcc7dcaddc633", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f3f0c2dd35fa4890a64fcc7dcaddc633"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f3f0c2dd35fa4890a64fcc7dcaddc633"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant: tempest-TestShelveInstance-1213112724 Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Id: f3f0c2dd35fa4890a64fcc7dcaddc633 Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-Tenant-Name: tempest-TestShelveInstance-1213112724 Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User: tempest-TestShelveInstance-1213112724-project Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Id: default Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Domain-Name: Default Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Id: fc7827c5d9294b8c90f26deff983b8e3 Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: X-User-Name: tempest-TestShelveInstance-1213112724-project Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: method: > Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: exception: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. Jul 20 19:42:21.991044 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: action_args: {'id': '67e24067-14b4-4dfd-93ea-3acf3fe777c2'} Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:42:21.992117 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. Jul 20 19:42:21.993834 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: ERROR nova.api.openstack.wsgi Jul 20 19:42:21.995687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Returning 404 to user: Instance 67e24067-14b4-4dfd-93ea-3acf3fe777c2 could not be found. {{(pid=117949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:42:21.995687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-0beb37b4-7b09-4404-adff-0b4b0c611d20 tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2" status: 404 len: 111 microversion: 2.1 time: 0.031544 Jul 20 19:42:21.995687 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 682/1373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:21 2022] GET /compute/v2.1/servers/67e24067-14b4-4dfd-93ea-3acf3fe777c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:42:22.157388 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-be1ae783-7854-4311-a9b6-ec6a5141926f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] Calling method '.version_select at 0x7f0e858e2c10>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:22.160585 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be1ae783-7854-4311-a9b6-ec6a5141926f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [cb49b8b4-b510-43ee-887c-f53094333ee2] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:42:22.915692 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:22.916596 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:22.923314 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:22.923764 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:22.924537 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:22.925006 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:23.060178 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:23.067653 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-5dded8b1-6a40-41aa-ac4a-54951a1f14d1 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.155818 Jul 20 19:42:23.068225 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 683/1374] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:22 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:42:23.168193 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [None req-be1ae783-7854-4311-a9b6-ec6a5141926f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] [cb49b8b4-b510-43ee-887c-f53094333ee2] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 37256. Jul 20 19:42:23.187075 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-be1ae783-7854-4311-a9b6-ec6a5141926f tempest-TestShelveInstance-1213112724 tempest-TestShelveInstance-1213112724-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-428519053" status: 202 len: 0 microversion: 2.1 time: 1.033773 Jul 20 19:42:23.187884 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 692/1375] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 19:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-428519053 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:42:24.085218 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:24.085942 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:24.094620 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.095805 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.096660 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.097362 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.249020 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:24.257908 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-c5f9f655-f03d-4209-b819-751ebba54cc3 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.176720 Jul 20 19:42:24.259103 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 684/1376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:24 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:24.377434 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG dbcounter [-] [117948] Writing DB stats nova_cell0:SELECT=4 {{(pid=117948) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:24.383070 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-c7383fa9-81db-4836-b66c-f4013b37de78 req-f9a72bea-6075-4dc1-8e1b-7cbea90889d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1", "name": "network-vif-plugged", "status": "completed", "tag": "50092e59-4883-423d-b2a1-0aa056a89899"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:24.395331 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c7383fa9-81db-4836-b66c-f4013b37de78 req-f9a72bea-6075-4dc1-8e1b-7cbea90889d9 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:24.396291 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-c7383fa9-81db-4836-b66c-f4013b37de78 req-f9a72bea-6075-4dc1-8e1b-7cbea90889d9 service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:24.408100 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-c7383fa9-81db-4836-b66c-f4013b37de78 req-f9a72bea-6075-4dc1-8e1b-7cbea90889d9 service nova] Creating event network-vif-plugged:50092e59-4883-423d-b2a1-0aa056a89899 for instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 on hv-cinder-85054 Jul 20 19:42:24.413353 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-c7383fa9-81db-4836-b66c-f4013b37de78 req-f9a72bea-6075-4dc1-8e1b-7cbea90889d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Jul 20 19:42:24.414257 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 693/1377] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:42:25.277190 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:25.278102 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:25.280219 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG dbcounter [-] [117949] Writing DB stats nova_cell0:SELECT=10 {{(pid=117949) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:42:25.286676 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.287212 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.288211 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:25.288723 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:25.426541 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:25.434554 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-823af347-5fe1-4917-abee-4f19a099bf69 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1315 microversion: 2.1 time: 0.162670 Jul 20 19:42:25.435131 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 685/1378] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:25 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:26.456006 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:26.456006 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:26.460148 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.460630 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.461451 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.461880 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.717280 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:26.724811 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-cbb58c12-0778-4110-abd4-22ce5a758fbb tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1464 microversion: 2.1 time: 0.276984 Jul 20 19:42:26.725410 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 694/1379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:26 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1464 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:26.764592 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:26.765162 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:26.771754 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.772200 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.772985 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.773423 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.802032 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Going to try to terminate instance {{(pid=117949) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:42:26.887243 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-20307b5a-be82-4719-93a4-6b8a77aaa53c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 204 len: 0 microversion: 2.1 time: 0.125887 Jul 20 19:42:26.888277 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 686/1380] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 19:42:26 2022] DELETE /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:42:26.899685 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:26.900308 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:26.907652 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.908110 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:26.908939 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:26.909383 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:27.129066 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.policy [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117948) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:27.138205 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-e72c0bb4-0197-4547-8a1d-ebfe8cdc314c tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1470 microversion: 2.1 time: 0.245657 Jul 20 19:42:27.138788 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 695/1381] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:26 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:28.156224 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:28.157135 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:28.164930 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:28.165374 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.166137 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:28.168189 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.322551 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:28.333119 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-dfc29065-8f40-44fe-90bb-0e44f84505d2 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1470 microversion: 2.1 time: 0.180845 Jul 20 19:42:28.333753 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 687/1382] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:28 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:28.917653 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [req-fac5091a-a94e-4f86-9afd-344d3b1090bf req-433ef186-8f2e-4b6d-8d0b-dc1f272fd98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1", "name": "network-vif-deleted", "tag": "50092e59-4883-423d-b2a1-0aa056a89899"}]} {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:42:28.931635 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-fac5091a-a94e-4f86-9afd-344d3b1090bf req-433ef186-8f2e-4b6d-8d0b-dc1f272fd98c service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:28.932102 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [req-fac5091a-a94e-4f86-9afd-344d3b1090bf req-433ef186-8f2e-4b6d-8d0b-dc1f272fd98c service nova] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:28.947412 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.compute.server_external_events [req-fac5091a-a94e-4f86-9afd-344d3b1090bf req-433ef186-8f2e-4b6d-8d0b-dc1f272fd98c service nova] Creating event network-vif-deleted:50092e59-4883-423d-b2a1-0aa056a89899 for instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 on hv-cinder-85054 Jul 20 19:42:28.955757 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [req-fac5091a-a94e-4f86-9afd-344d3b1090bf req-433ef186-8f2e-4b6d-8d0b-dc1f272fd98c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043792 Jul 20 19:42:28.960020 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 696/1383] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 19:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:42:29.350437 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.api.openstack.wsgi [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:29.351742 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.compute.api [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117949) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:29.360966 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.361639 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.362855 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.363460 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.401488 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:29.402826 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG oslo_concurrency.lockutils [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:29.403612 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.objects.instance [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lazy-loading 'fault' on Instance uuid e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 {{(pid=117949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:42:29.467973 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: DEBUG nova.policy [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9038a6d909342fb979b2a42534ff93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f87e7aec9f4fa7a23ba9ea65d2d733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117949) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:42:29.479441 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO nova.api.openstack.requestlog [None req-2f1eb9f1-f149-4e69-892c-81cf24f36e92 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 200 len: 1305 microversion: 2.1 time: 0.132772 Jul 20 19:42:29.481760 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: [pid: 117949|app: 0|req: 688/1384] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:29 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:42:30.499120 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Calling method '>' {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:42:30.500003 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.compute.api [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] [instance: e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1] Fetching instance by UUID {{(pid=117948) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:42:30.506707 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.507430 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.508221 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:42:30.508665 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG oslo_concurrency.lockutils [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Lock "5483e977-c2fb-4c18-b67f-daecf8b173f5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:42:30.524479 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.wsgi [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] HTTP exception thrown: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Request method failure captured: Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: request: GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 HTTP/1.1 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept: application/json Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Accept-Encoding: identity Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Connection: close Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Length: 0 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Content-Type: application/json Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Host: 10.222.0.79 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Openstack-System-Scope: None Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: User-Agent: python-urllib3/1.26.9 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Auth-Token: gAAAAABi2FqRqpkUHUNJlqFq_xZ4ytJpfP4apC3AvlQizRAfxn1KKD9UfGPeeR3p0szl39ITtaqqmQwHLgY_qE6lQadtS1XVkqY9p4ACFZ2_kdz94jaoWAJIk2YA2xOo6tCzJd5yIIEYp4z7etFExRR8k61yBBxxQR2vhpNHxRAV6h8Sa1AOHaw Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Id: None Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Domain-Name: None Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Identity-Status: Confirmed Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Is-Admin-Project: True Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Id: default Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Domain-Name: Default Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Id: 67f87e7aec9f4fa7a23ba9ea65d2d733 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Project-Name: tempest-VolumesNegativeTest-1534382368 Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Role: reader,member Jul 20 19:42:30.526450 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Roles: reader,member Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67f87e7aec9f4fa7a23ba9ea65d2d733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_67f87e7aec9f4fa7a23ba9ea65d2d733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/67f87e7aec9f4fa7a23ba9ea65d2d733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/67f87e7aec9f4fa7a23ba9ea65d2d733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}] Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant: tempest-VolumesNegativeTest-1534382368 Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Id: 67f87e7aec9f4fa7a23ba9ea65d2d733 Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-Tenant-Name: tempest-VolumesNegativeTest-1534382368 Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User: tempest-VolumesNegativeTest-1534382368-project Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Id: default Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Domain-Name: Default Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Id: f9038a6d909342fb979b2a42534ff93e Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: X-User-Name: tempest-VolumesNegativeTest-1534382368-project Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: method: > Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: exception: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. Jul 20 19:42:30.528228 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: action_args: {'id': 'e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1'} Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: {{(pid=117948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:42:30.529387 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. Jul 20 19:42:30.530989 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: ERROR nova.api.openstack.wsgi Jul 20 19:42:30.532235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: DEBUG nova.api.openstack.wsgi [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] Returning 404 to user: Instance e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 could not be found. {{(pid=117948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:42:30.532235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO nova.api.openstack.requestlog [None req-8e2a21bb-afa5-42d3-a30c-b7817a74c920 tempest-VolumesNegativeTest-1534382368 tempest-VolumesNegativeTest-1534382368-project] 10.222.0.79 "GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1" status: 404 len: 111 microversion: 2.1 time: 0.034513 Jul 20 19:42:30.532235 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: [pid: 117948|app: 0|req: 697/1385] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 19:42:30 2022] GET /compute/v2.1/servers/e1c41b00-c2a3-4f60-a645-2ea0be8ed5b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:43:11.670586 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:43:11.671477 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Wed Jul 20 19:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:44:00.175816 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:44:00.176462 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:44:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:44:43.593401 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:44:43.594229 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:46:31.679132 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:46:31.679774 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Wed Jul 20 19:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:47:20.184321 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:47:20.184987 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:47:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:48:01.276636 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:48:01.277186 dv-cinder-850548-1-iscsi devstack@n-api.service[117948]: Wed Jul 20 19:48:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:48:03.602429 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:48:03.603066 dv-cinder-850548-1-iscsi devstack@n-api.service[117949]: Wed Jul 20 19:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!